-- Logs begin at Wed 2022-08-24 12:29:14 UTC, end at Wed 2022-08-24 13:36:36 UTC. -- Aug 24 12:59:03.143575 dv-cinder-779578-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 12:59:03.152400 dv-cinder-779578-4-smb devstack@keystone.service[81721]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 12:59:03 2022] *** Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: nodename: dv-cinder-779578-4-smb Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: machine: x86_64 Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: clock source: unix Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: pcre jit disabled Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: detected number of CPU cores: 4 Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: current working directory: / Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: detected binary path: /usr/bin/uwsgi-core Aug 24 12:59:03.154780 dv-cinder-779578-4-smb devstack@keystone.service[81721]: your processes number limit is 47680 Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: your memory page size is 4096 bytes Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: detected max file descriptor number: 2048 Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: lock engine: pthread robust mutexes Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: thunder lock: enabled Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 12:59:03.155437 dv-cinder-779578-4-smb devstack@keystone.service[81721]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 12:59:03.194193 dv-cinder-779578-4-smb devstack@keystone.service[81721]: Python main interpreter initialized at 0x55d28bbab9c0 Aug 24 12:59:03.194193 dv-cinder-779578-4-smb devstack@keystone.service[81721]: python threads support enabled Aug 24 12:59:03.194193 dv-cinder-779578-4-smb devstack@keystone.service[81721]: your server socket listen backlog is limited to 100 connections Aug 24 12:59:03.194193 dv-cinder-779578-4-smb devstack@keystone.service[81721]: your mercy for graceful operations on workers is 90 seconds Aug 24 12:59:03.194629 dv-cinder-779578-4-smb devstack@keystone.service[81721]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 12:59:03.194629 dv-cinder-779578-4-smb devstack@keystone.service[81721]: *** Operational MODE: preforking *** Aug 24 12:59:03.194927 dv-cinder-779578-4-smb devstack@keystone.service[81721]: *** uWSGI is running in multiple interpreter mode *** Aug 24 12:59:03.194927 dv-cinder-779578-4-smb devstack@keystone.service[81721]: spawned uWSGI master process (pid: 81721) Aug 24 12:59:03.195155 dv-cinder-779578-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 12:59:03.197001 dv-cinder-779578-4-smb devstack@keystone.service[81721]: spawned uWSGI worker 1 (pid: 81732, cores: 1) Aug 24 12:59:03.197001 dv-cinder-779578-4-smb devstack@keystone.service[81721]: spawned uWSGI worker 2 (pid: 81733, cores: 1) Aug 24 12:59:03.197001 dv-cinder-779578-4-smb devstack@keystone.service[81721]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 12:59:07.470732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:59:07.470732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: from cryptography.utils import int_from_bytes Aug 24 12:59:07.471607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:59:07.471607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: from cryptography.utils import int_from_bytes Aug 24 12:59:07.471725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:59:07.471725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: from cryptography.utils import int_from_bytes Aug 24 12:59:07.471725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 12:59:07.471725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: from cryptography.utils import int_from_bytes Aug 24 12:59:07.521077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:59:07.521280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:59:07.521436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] command line args: [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:59:07.521703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:59:07.521878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ================================================================================ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:59:07.522133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] admin_token = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.522358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 12:59:07.522449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] config_dir = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.522551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.522633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 12:59:07.522730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] config_source = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.522810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] command line args: [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 12:59:07.522905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] debug = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.522991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 12:59:07.523102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ================================================================================ {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 12:59:07.523455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] admin_token = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] config_dir = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.523916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] config_source = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] debug = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_config_append = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.524884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_dir = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_config_append = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.525865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_dir = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_file = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.526891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.527999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.528134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.528217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.528709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.528793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.528940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] publish_errors = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.529962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] publish_errors = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] standard_threads = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.530858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] use_journal = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] use_json = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.531947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] use_stderr = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] standard_threads = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] use_syslog = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.532780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] use_journal = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.532864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.532955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] use_json = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.533087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.533163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] use_stderr = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.533288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] use_syslog = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.533363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.533519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 12:59:07.533596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.533776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.533858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.534977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.535946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.536924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.537997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.538958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.539951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.540879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.541966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.542963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.543900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.544983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.545968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.546984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547257 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.547892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.548905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.549949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.550940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.551900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.552887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.553941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.554896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.555980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.556883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.557939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.external = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.558988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.password = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.559982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.external = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] auth.token = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.560938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.password = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] auth.token = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.561953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.562987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.563993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.564931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.565860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.566968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.567914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.568989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.569914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.570984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.571929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.572981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.573896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.574989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575137 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.575911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.576879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.577798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.578984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.579953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.580983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.581992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.582886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.583914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.584992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.585909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.586959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.587976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.588877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.589897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.590944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.591900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.592948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.593963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.594943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] role.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] role.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.595886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] role.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] role.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.596960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.597947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.598997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.599994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.600798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.601932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.602892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.603970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.604965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.605856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.connection = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.606906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.607992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.608486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.608682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.608858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.609923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.610939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.611105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.611305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.611485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.611651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.611839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.612832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.613879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.614552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 12:59:07.615779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 12:59:07.637140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.637334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.637705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.639850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.640076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.640296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.646506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.648844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.675404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.675604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.675797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.675880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.729673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.729954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.779348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.779605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.780690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.780940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.941996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.942088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.942166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.942240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.942390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.965767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.966987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.967633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.978795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.978983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.992914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:07.993740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 12:59:08.010635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.010864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.011001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 12:59:08.011165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 12:59:08.011329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.011459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.011585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 12:59:08.011723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 12:59:08.011797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.011876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.011941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.012103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.012222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.012333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.012741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.012863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.022350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.022500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.022604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.022691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.022905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.023027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.023171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.023312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.030642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.030780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.033586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.033696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.033874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.033963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.034986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.035946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.036036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.036222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.036311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.036495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.036583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.059647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.059946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.061129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.061454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.061577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.061798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.066239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.066495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.066617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.066805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.066926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.067087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.073259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.073543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.073686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.073832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.077730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.078018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.078141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.078317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.078466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.078584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.078674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.078880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.079951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.097413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.097704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.097828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.098071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.101698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.101989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.104944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.105241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.105364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.105534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.109543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.109844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.112713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.112997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.116017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.116982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.117140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.117263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.117414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.117549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.117744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.133406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.133698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.133965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.134112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.134209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.134287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.134523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.134797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.141217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.141793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.142839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.143134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.143322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.143620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.145798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.146086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.146250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.146343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.146524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.146650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.146815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.146942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.147115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.147421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.158709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.158998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.159243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.159367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.159561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.159687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.159824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.159918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.160106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.160238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.160386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.160525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.160742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.161028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.176013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.176596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.179057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.179664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.181991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.182568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.183476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.184034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.184961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.185242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.185533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.185659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.185789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.186096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.192092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.192860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.193569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.194325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.196577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.196864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.197151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.197310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.197400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.197597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.197884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.198170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.205508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.205802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.206087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.206279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.206572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.206858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.213020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.213307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.213592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.213799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 12:59:08.213886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.214995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.215855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.216815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.217089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.217348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 12:59:08.251139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d28bbab9c0 pid: 81733 (default app) Aug 24 12:59:08.252064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d28bbab9c0 pid: 81732 (default app) Aug 24 12:59:08.254719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f03f2-19c8-4ea8-8f13-86e71a8d0dcb None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:08.255030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f03f2-19c8-4ea8-8f13-86e71a8d0dcb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:08.255330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f03f2-19c8-4ea8-8f13-86e71a8d0dcb None None] PATH_INFO: `/v3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:08.259578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Aug 24 12:59:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:14.920538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:14.921193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:14.921193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:14.925342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 12:59:14.938340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:14.938906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:14.938906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:15.013056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: INFO dbcounter [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] Registered counter for database keystone Aug 24 12:59:15.034085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG oslo_db.sqlalchemy.engines [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:59:15.042466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writer thread running {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:59:15.237617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG passlib.handlers.bcrypt [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81733) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 12:59:15.237977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG passlib.handlers.bcrypt [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81733) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 12:59:15.297287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:15.298936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:15.437636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 12:59:15.940625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:16.014010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: INFO dbcounter [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] Registered counter for database keystone Aug 24 12:59:16.036999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG oslo_db.sqlalchemy.engines [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 12:59:16.044804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writer thread running {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 12:59:16.164164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f65ef-2b05-4d63-97a5-c4cbf56b424e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:16.168952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:16.169594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:16.169872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:16.170148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:16.179038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:16.230309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 12:59:16.230501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c8d8-6311-4e64-b236-09f03756b43f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:16.241082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 24 12:59:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 12:59:16.247283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:16.262435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7fc38-f7be-4d9e-bdbe-e89ee0efe51f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:16.267969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:16.269120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:16.269399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:16.269671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] PATH_INFO: `/v3/projects/a1e6eefe19074b16ac82b646f2c6375a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:16.271379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] RBAC: Authorizing `identity:get_project(project_id=a1e6eefe19074b16ac82b646f2c6375a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:16.324410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 12:59:16.324720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c3df7-3660-436d-adeb-cdd88bfa7631 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:16.329558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Aug 24 12:59:16 2022] GET /identity/v3/projects/a1e6eefe19074b16ac82b646f2c6375a => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:18.216796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0021-ae66-4e66-8d88-87d33b45021d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:18.217381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0021-ae66-4e66-8d88-87d33b45021d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:18.217381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0021-ae66-4e66-8d88-87d33b45021d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:18.221560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:18.227656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:18.228189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:18.228189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:18.249848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:18.251414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:18.259736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 12:59:18.520661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0021-ae66-4e66-8d88-87d33b45021d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:18.534796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0021-ae66-4e66-8d88-87d33b45021d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:18.539790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:18.540406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:18.540681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:18.540945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:18.549817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:18.551663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb53c75-d0fd-40d1-a12c-205d6b4d3cd3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:18.561695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 24 12:59:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 12:59:18.567605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:18.577743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca738-6893-468a-a6e2-310de9035b33 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:18.582420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:18.583069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:18.583385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:18.583661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:18.585045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:18.586901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4c5f2-b523-4a65-a76a-3e0a9c3ede7d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:18.588519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Aug 24 12:59:18 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:20.575174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2578-1dff-4164-bf8a-92d6b5082518 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:20.575798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2578-1dff-4164-bf8a-92d6b5082518 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:20.575798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2578-1dff-4164-bf8a-92d6b5082518 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:20.577328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:20.582602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:20.583077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:20.583302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:20.605488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:20.606688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:20.610925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ed2-81bf-40e2-a201-986075742dff None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:20.611434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ed2-81bf-40e2-a201-986075742dff None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:20.611906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ed2-81bf-40e2-a201-986075742dff None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:20.614154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:20.621930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:20.622211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:20.622482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:20.665812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG passlib.handlers.bcrypt [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81732) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 12:59:20.666235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG passlib.handlers.bcrypt [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81732) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 12:59:20.691838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:20.712044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:20.713666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:20.818297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:20.957589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:20.982578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.075348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5f26-0b9c-435f-b7dc-78e29320ca56 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.083681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.114682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.115391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.115670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.115944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.129590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:21.138281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:21.139439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:21.140316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:21.145944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.221751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c4ce7-665e-4af9-b881-70884a1596fc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.224540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.237903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.257947 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e5a4e-f3f1-41cd-b1fe-b10c7372767f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.264537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.265429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.265713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.265990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.295256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.295911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.296210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.296474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.297149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:21.297450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.298876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.311848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:21.317898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.338956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.340553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.437638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523764a-7712-4d68-8e60-630ee3d50a35 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.461042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:21.467001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.470066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.478863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.479473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.479762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.480028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.481184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.482653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.484359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:21.490213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.505088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.572758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee19de-056e-4c8c-9581-dd6c606992fd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.596036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190033-f7da-48e2-baa4-5acf0cba6f38 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.612175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.613569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.613569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.613569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.632967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.634266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.634474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.634913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.635298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.635570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.636781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.638185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.639963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:21.646096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 12:59:21.655136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:21.656213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 12:59:21.657196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 12:59:21.657196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 12:59:21.657196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:21.657196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:21.663369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:21.728799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.733522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:21.754889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc50782-b637-4fca-84e8-b1fe7fa9ab33 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.787755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab8076-76b4-490c-ac45-0201d78c0088 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:21.793065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.793683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.793964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.794236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.794968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.domain.id=default, user.id=91ee51bf97df4d1480625733920e3461) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:21.795306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.796869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a0ce-f2ec-4bd8-9a39-636daf1b02e4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.804546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/role_assignments?user.id=91ee51bf97df4d1480625733920e3461&scope.domain.id=default&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:21.824441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:21.825078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:21.825337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:21.825611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:21.826303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:21.826614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:21.828190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31104f-fe52-454f-b592-9b449a4c3b8c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:21.849910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:24.070986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e71c-67e1-45fc-b181-62aaec617201 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.072048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e71c-67e1-45fc-b181-62aaec617201 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.072537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e71c-67e1-45fc-b181-62aaec617201 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.074079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 12:59:24.079852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df142f8b-d14c-449e-8594-59fe98e068e6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.080736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df142f8b-d14c-449e-8594-59fe98e068e6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.081220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df142f8b-d14c-449e-8594-59fe98e068e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.107342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-df142f8b-d14c-449e-8594-59fe98e068e6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:24.108956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-df142f8b-d14c-449e-8594-59fe98e068e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:24.148956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e99c6-e03d-4290-a6d4-b6182d02d149 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.149264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e99c6-e03d-4290-a6d4-b6182d02d149 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.149510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e99c6-e03d-4290-a6d4-b6182d02d149 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.151035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 13/23] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 12:59:24.157011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ca32-0b29-4375-af67-f9f0a2abe6ad None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.157293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ca32-0b29-4375-af67-f9f0a2abe6ad None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.157553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ca32-0b29-4375-af67-f9f0a2abe6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.188431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-08e4ca32-0b29-4375-af67-f9f0a2abe6ad None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:24.191647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-08e4ca32-0b29-4375-af67-f9f0a2abe6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:24.265084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:24.328605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:24.346289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce0c8e-82e0-4262-b75e-36f2ba8cac0a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.346590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce0c8e-82e0-4262-b75e-36f2ba8cac0a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.346840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce0c8e-82e0-4262-b75e-36f2ba8cac0a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.348478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 12/26] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:24.354068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.354343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.354679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.377387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:24.378585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:24.469185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:24.731731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce0c8e-82e0-4262-b75e-36f2ba8cac0a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:24.793974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:24.866333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce0c8e-82e0-4262-b75e-36f2ba8cac0a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:24.891145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:24.895546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:24.922269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:24.922958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:24.923314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:24.923617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:24.946083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:24.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:24.954331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:24.955042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 13/28] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:24.960974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.083422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f3ec-f9fb-4534-9c51-aecbe4afeb0d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.093236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:25.105047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbb31a-7c3c-450f-9859-c765b31cb990 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.138805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.139858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.140383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.140845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.141710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:25.142196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.143886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808ea8a-86c5-4de9-be41-685f56043652 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.159098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:25.160894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ddfb-bb1f-4774-a87c-2369c202416a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.161715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ddfb-bb1f-4774-a87c-2369c202416a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.162204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9ddfb-bb1f-4774-a87c-2369c202416a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.163818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 15/30] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:25.166764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9ddfb-bb1f-4774-a87c-2369c202416a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.174325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.175928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.176802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.177381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.199270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.202981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 12:59:25.232200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:25.233168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 12:59:25.234043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 12:59:25.234043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 12:59:25.234043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:25.240723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 16/31] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:25.242359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.340915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:25.377260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9ddfb-bb1f-4774-a87c-2369c202416a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.404232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb25b-dd2f-4bee-adcb-51a14618d633 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.437961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.440582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.442608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.443649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.444368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.448308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.457209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.458135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.458420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.459873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.462492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.464021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0f1d-c3f8-453d-96ac-2091185a5443 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.466943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 17/32] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:25 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:25.468438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.469257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.469257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.510144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:25.511412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:25.608775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 18/33] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:25.608775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.629499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 16/34] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 12:59:25 2022] POST /identity/v3/roles => generated 219 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:25.630485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.700240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:25.715605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:25.790379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61abfe5-f07f-430c-b596-3cf79b95d777 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.835415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.835618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b5931-27c6-4685-90b4-20a1d6599a3f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:25.836555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.837069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.837530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.838373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:25.838883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.840549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112726e7-c9e6-4a2f-a80e-0ccbe22bc705 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.860130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 19/35] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 12:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:25.861707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285f46-0809-49a6-9dc9-94b5e4ee438f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.862871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285f46-0809-49a6-9dc9-94b5e4ee438f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.863389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285f46-0809-49a6-9dc9-94b5e4ee438f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.865091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 20/36] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:25.866371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4aa79-a562-4c61-9e16-c9ef52833816 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.866902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4aa79-a562-4c61-9e16-c9ef52833816 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.867390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4aa79-a562-4c61-9e16-c9ef52833816 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.869402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 21/37] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:25.870574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4aa79-a562-4c61-9e16-c9ef52833816 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:25.882449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:25.884787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.884787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.884787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.885244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:25.886983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0ac6-2a18-4f42-93d4-3c63955a41f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:25.889221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 17/38] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:25.894164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a5a5-73c1-4707-941b-1b976b379aff None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.894164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a5a5-73c1-4707-941b-1b976b379aff None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.894164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38a5a5-73c1-4707-941b-1b976b379aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.912966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ad38a5a5-73c1-4707-941b-1b976b379aff None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:25.914603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad38a5a5-73c1-4707-941b-1b976b379aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:25.982964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 18/39] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:25.984345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:25.984641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:25.984992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:25.988006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4aa79-a562-4c61-9e16-c9ef52833816 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.002579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:26.005675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:26.007210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:26.024355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.024973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.025258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.025531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.026183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.027684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.031939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:26.082910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 19/40] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:26.083852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:26.162095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 22/41] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 12:59:25 2022] POST /identity/v3/projects => generated 301 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:26.163058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:26.208435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4007-2be9-40df-9c22-3638e1434f4c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.264345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.265411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.265411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.265702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] PATH_INFO: `/v3/domains/default/users/91ee51bf97df4d1480625733920e3461/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.268196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=91ee51bf97df4d1480625733920e3461, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.269835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.290782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51ec4d-ec8b-4f8c-9508-8e0e674bcc97 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.295323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 20/42] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Aug 24 12:59:26 2022] PUT /identity/v3/domains/default/users/91ee51bf97df4d1480625733920e3461/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:26.296618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:26.322252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:26.380572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.381221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.381505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.381786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.382481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.384075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.422810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 23/43] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 12:59:26 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:26.422810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:26.441535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f721d8-a9d3-4476-a76a-2e7f4b310c9a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.468425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:26.514504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.515065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.515360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.515656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.516401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.517844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.558449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 21/44] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 12:59:26 2022] POST /identity/v3/roles => generated 223 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:26.595415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add85922-6fa3-4e35-b81d-8cddadc0df22 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.646346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.647026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.647359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.647636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.649028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.650565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48899a4-7649-4da8-a4dd-5dd799e585b5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.652593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 24/45] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:26.658968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:26.765290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:26.792395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe692-8853-44c0-a799-19822b4ac1bb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:26.828495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:26.829126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:26.829406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:26.829680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:26.830374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:26.831889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa47a77-fd6b-4c52-8fc7-51af5a2d16be None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:26.862091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 22/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 12:59:26 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:28.344516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355b7e-120a-49ff-88af-1fab9e76da5a None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:28.345106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355b7e-120a-49ff-88af-1fab9e76da5a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:28.345106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355b7e-120a-49ff-88af-1fab9e76da5a None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:28.346414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 25/47] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:28.352080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77684-d97f-4919-b2d4-c529def654f1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:28.352517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77684-d97f-4919-b2d4-c529def654f1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:28.352613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe77684-d97f-4919-b2d4-c529def654f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:28.371404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cfe77684-d97f-4919-b2d4-c529def654f1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:28.372628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cfe77684-d97f-4919-b2d4-c529def654f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:28.441873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 23/48] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:28.703847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355b7e-120a-49ff-88af-1fab9e76da5a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:28.783344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4436c5-420b-4a7c-8f6b-c7bde26cc8fe None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:28.783633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4436c5-420b-4a7c-8f6b-c7bde26cc8fe None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:28.783913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4436c5-420b-4a7c-8f6b-c7bde26cc8fe None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:28.785354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 24/49] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:28.792356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:28.792647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:28.792931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:28.812583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:28.813822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:28.871913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:28.891367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 25/50] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:28.927766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:28.935583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355b7e-120a-49ff-88af-1fab9e76da5a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:28.971491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:28.972133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:28.972413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:28.972686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:28.983280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:28.988021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:28.988979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:28.990028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 26/51] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:28.995148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.098836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5b090-9e27-4e4e-8d5f-3594387cc62b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.134490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.134998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.135306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.135575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.136241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:29.136544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.137943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.148539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 26/52] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:29.154550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.154758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.273354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859bfe-ae41-46ba-9a00-abae47eac9d6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.308566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.309314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.309592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.309869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.311012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.312553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.314144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:29.318966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:29.319976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.344189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:29.370500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39467f-cc76-467e-9687-df6dc7e1f024 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.406844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.407438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.407715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.408008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.409139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.410592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.412378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 27/54] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:29 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:29.418079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.422475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f043-5f03-4a95-bb54-4addee4a6925 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.457217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.457833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.458113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.458379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.459033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.460580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.488396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 28/55] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 24 12:59:29 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:29.529718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29156e-3bff-4455-ac74-7a38e23355de None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.549817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:29.569004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.569668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.569947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.570216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.571496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.572955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e1a0-7895-4063-8b6c-e16befb3754c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.574618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 28/56] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:29.580786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:29.665521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:29.692866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ff0de-6cd4-4293-9c14-21226e9121d1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:29.725438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:29.726055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:29.726341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:29.726617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:29.727387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.domain.id=default, user.id=91ee51bf97df4d1480625733920e3461) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:29.727736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:29.729218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219036a4-cd3b-4c63-bd41-57ff7e8a303e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:29.735314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 29/57] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 24 12:59:29 2022] GET /identity/v3/role_assignments?user.id=91ee51bf97df4d1480625733920e3461&scope.domain.id=default&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:31.402194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff0cd-3f7f-4eba-b1c5-bc5b7b1ffddb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:31.402728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff0cd-3f7f-4eba-b1c5-bc5b7b1ffddb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:31.402845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff0cd-3f7f-4eba-b1c5-bc5b7b1ffddb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:31.405156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 29/58] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:31.413086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:31.413515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:31.413597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:31.433020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:31.434564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:31.505086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:31.774433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff0cd-3f7f-4eba-b1c5-bc5b7b1ffddb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:31.887652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff0cd-3f7f-4eba-b1c5-bc5b7b1ffddb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:31.924800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:31.925432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:31.925707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:31.925975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:31.927229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:31.928678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15832a87-56f1-4942-9b24-1a75de2df061 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:31.930247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 30/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:31.936269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:32.021822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:32.057542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b32a-c8e8-48b9-908f-2af4ee280aeb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:32.092790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:32.093398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:32.093678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:32.093946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:32.094695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:32.096201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8275-b627-4300-92d4-20bd3c210f89 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:32.124888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 31/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:31 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:35.233745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fe03-9d56-41c8-9f7a-a80376d49d40 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.234301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fe03-9d56-41c8-9f7a-a80376d49d40 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.234301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fe03-9d56-41c8-9f7a-a80376d49d40 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.235708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:35.241600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8214c-ffbb-4a9f-a53a-842ea5b73aeb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.242427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8214c-ffbb-4a9f-a53a-842ea5b73aeb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.242869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8214c-ffbb-4a9f-a53a-842ea5b73aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.272229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-38e8214c-ffbb-4a9f-a53a-842ea5b73aeb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:35.273678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-38e8214c-ffbb-4a9f-a53a-842ea5b73aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:35.368568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 32/63] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:35.429033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12cd5d-7ed9-490a-bf76-9b676d33d2c4 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.429324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12cd5d-7ed9-490a-bf76-9b676d33d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.429609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12cd5d-7ed9-490a-bf76-9b676d33d2c4 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.430984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 32/64] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:35.441693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b271f4-ab58-4dee-9291-c3354f895439 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.442193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b271f4-ab58-4dee-9291-c3354f895439 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.442633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b271f4-ab58-4dee-9291-c3354f895439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.472231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-09b271f4-ab58-4dee-9291-c3354f895439 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:35.473700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-09b271f4-ab58-4dee-9291-c3354f895439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:35.537667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:35.564916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 33/65] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:35.691418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12cd5d-7ed9-490a-bf76-9b676d33d2c4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:35.770506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:35.781343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f88f-720b-4585-9795-1f902549f401 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.781956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f88f-720b-4585-9795-1f902549f401 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.782427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1f88f-720b-4585-9795-1f902549f401 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.784046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 34/66] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:35.785415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1f08-3fcd-4816-a122-b7d59159c284 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.785890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1f08-3fcd-4816-a122-b7d59159c284 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.786354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f1f08-3fcd-4816-a122-b7d59159c284 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.788209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 35/67] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:35.794152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.794518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.795008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.818854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:35.820698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:35.822570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12cd5d-7ed9-490a-bf76-9b676d33d2c4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:35.862280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:35.863341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.863633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.863909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.876090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5ee2893c-7309-44f8-ba41-d54f0144b212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:35.881965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:35.882936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:35.883704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:35.886217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 33/68] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:35.888855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:35.889587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:35.890117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:35.907244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 36/69] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:35.912111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:35.915711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:35.917211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:36.032791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb8588-705a-4796-b136-3707b9bc1703 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.043918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 34/70] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:36.043918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.050664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.073386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.074432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.074863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.075342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.076169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:36.076713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.078292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f71996-f7fa-4dd9-b154-305a572b26f3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.087943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 37/71] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.089600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccbeb-365f-42f7-8249-54c7b461c14a None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.090069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccbeb-365f-42f7-8249-54c7b461c14a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.090518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccbeb-365f-42f7-8249-54c7b461c14a None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.092162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 38/72] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:36.097427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ccbeb-365f-42f7-8249-54c7b461c14a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.108779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.170871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437a032-2c21-4f16-9bd9-fa5e903fbbae None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.206079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.206717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.207007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.207321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.211729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ccbeb-365f-42f7-8249-54c7b461c14a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.218633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7ff8ee80-ca45-4be4-8d50-ece81ff0a1e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:36.224016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:36.224882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:36.225617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 35/73] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:36.226908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.227004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.227305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.246089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:36.247351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:36.254874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.255818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.255818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.256086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.257247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.258741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.265389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 39/74] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.265389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.315804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.327940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 36/75] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:36.328804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.377859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.379150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877addf-28b9-456c-9eff-2c8986b45841 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.417741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.418373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.418666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.418925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.430314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:36.435842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:36.436723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 40/76] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:36.440307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.458377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42222f8-cb82-4242-8bd2-fabc7bce471b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.493960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.494590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.494873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.495147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.495859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:36.496167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.497562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.505940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 37/77] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.506749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.552689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d2830-f63a-43ec-838d-ccab9aa481fb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.556729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.592918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.593664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.594010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.594292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.613985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.620379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d355b-e91b-4468-88d2-55ebad946d2a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.654217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.654880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.655156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.655458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.666380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:36.670612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:36.671740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:36.672573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:36.673406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:36.673964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.674037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 38/78] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:36.674037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.775851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 41/79] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:36.775851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.781120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcfc53-0a0c-4c89-b04d-0d27efb7a6a5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.783120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.812945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.813599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.813882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.814158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.814832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:36.815136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.816614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.829650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 39/80] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.829650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.846114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:36.885669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ccb8e-16a7-42fd-9202-818c7227fcea None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.921115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.921755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.922037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.922313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.926834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413c67f-d91f-4674-8aa2-0dad138dff40 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:36.936069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.937621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.939301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 42/81] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.940081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:36.965569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:36.966219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:36.966504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:36.966779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:36.968024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:36.969502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:36.971104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 40/82] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:36.971922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.004191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.043097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766a79-d984-4fb3-a576-f5c2018505d4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.057900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.073779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe86fb5-f974-4aed-b725-fca2bb05ab13 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.079665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.080298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.080578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.080848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.081529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:37.081829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.083279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.091790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 43/83] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.092659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.108443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.109007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.109284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.109555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.110728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.112211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.113850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 41/84] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:36 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.114607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.196896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d241ac-6030-4671-b330-08d45a8025e1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.214963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b12a-9fcd-48b1-b6d4-0656e91c070d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.220513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.232100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.232753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.233008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.233283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.234489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.235997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.237827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 44/85] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.238365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.254773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.255422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.255704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.255978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.281887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.325108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.326674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.341241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46dad9-a656-4c4a-bff7-135c00c659f1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.378468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.379101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.379418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.379693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.380350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.381816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.405926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 45/86] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:37 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:37.406766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.445123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:37.446037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.473188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.519635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.540585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dd7c-4733-4320-8219-2c912ea510ee None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.570879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642e29-0007-4623-aefd-28b0e48b48e0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.582252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.582924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.583229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.583529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.584801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.586326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.588128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 46/88] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.588956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.615849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.616476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.616762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.617178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.618271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=91ee51bf97df4d1480625733920e3461) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:37.618599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.620225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.629584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 43/89] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/role_assignments?user.id=91ee51bf97df4d1480625733920e3461&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.630174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.729877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd9e8-1866-4b08-b28f-7dc0fe7dead0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.761781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.772701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb3e8-4100-44c4-8800-4065aab25f1c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.787994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.788626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.788897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.789176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.803128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:37.820990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.821693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.821977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.822243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:37.823454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.824920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.826627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 44/90] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:37.827622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.874606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:37.876147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:37.955043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a586a2-45a6-4b63-846e-7571f2048711 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:37.986999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 47/91] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:37.991213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:37.997685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:37.998807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:37.999317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:37.999787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.006267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:38.098565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:38.098893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231261-acae-4650-9603-e62dfea6a617 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:38.122848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.124857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.136452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:38.137092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:38.137370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:38.137641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.138391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:38.138701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.140549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.151219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 48/92] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:38.151219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:38.287572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:38.292069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630cd6-959f-4afe-9a28-186c721a27b6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:38.323367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 45/93] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:38.329634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:38.400655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:38.402015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:38.402522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:38.402995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] PATH_INFO: `/v3/projects/e07e99170e4341dda95f14e72d50ed79` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.404780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] RBAC: Authorizing `identity:get_project(project_id=e07e99170e4341dda95f14e72d50ed79)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.406485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.409853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 49/94] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:38 2022] GET /identity/v3/projects/e07e99170e4341dda95f14e72d50ed79 => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:38.422242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:38.456425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:38.484920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944b60e-95f5-42ec-9ed0-8e8497043b1d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:38.558541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:38.559572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:38.560106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:38.560577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.562083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.563808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.565722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 46/95] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:38 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:38.579403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:38.620461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7c4fa-e210-4f42-b42c-2fb22d395487 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:38.694202 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:38.694872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:38.695157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:38.695453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.696192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=e07e99170e4341dda95f14e72d50ed79, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:38.696498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.698021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc6a78-3bb0-422b-b221-ef4d1470c5c5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.704848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 50/96] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:38 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=e07e99170e4341dda95f14e72d50ed79&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:38.794108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6bad-e92e-4299-8acc-b7b691bb71b0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:38.845648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:38.846230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:38.846505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:38.846784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:38.847575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:38.847890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:38.849397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47d1a7-b744-4aa3-a436-968dfb863318 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:38.857102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 47/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:38 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=56a6a91609874159a6cf397498dea0cd => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:40.005147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14d7c-c212-48e7-8b91-703a75e6c3f7 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.005879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14d7c-c212-48e7-8b91-703a75e6c3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.005879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14d7c-c212-48e7-8b91-703a75e6c3f7 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.007620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 51/98] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:40.013290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2753-7bbd-4560-97bb-7e0d0e8b3c16 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.014399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2753-7bbd-4560-97bb-7e0d0e8b3c16 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.014886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2753-7bbd-4560-97bb-7e0d0e8b3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.040849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a82f2753-7bbd-4560-97bb-7e0d0e8b3c16 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:40.042395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a82f2753-7bbd-4560-97bb-7e0d0e8b3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:40.062021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:40.125631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:40.428283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cedf6a-0e48-4eea-a57d-34a5fddca94d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.428950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cedf6a-0e48-4eea-a57d-34a5fddca94d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.429453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cedf6a-0e48-4eea-a57d-34a5fddca94d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.431032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 52/100] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:40.438738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5f63-8507-4d3c-a269-a0090f7fdf8f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.439368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5f63-8507-4d3c-a269-a0090f7fdf8f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.439837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5f63-8507-4d3c-a269-a0090f7fdf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.458801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c7aa5f63-8507-4d3c-a269-a0090f7fdf8f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:40.464583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c7aa5f63-8507-4d3c-a269-a0090f7fdf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:40.570312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 49/101] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:40.637577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cedf6a-0e48-4eea-a57d-34a5fddca94d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:40.660881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:40.789296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cedf6a-0e48-4eea-a57d-34a5fddca94d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:40.837720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:40.838392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.838678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.838951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.852902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:40.858445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:40.859869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:40.861833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 53/102] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:40.866423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4493c-1a1c-466b-bcc7-10a47fe1cf36 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.866563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:40.867203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4493c-1a1c-466b-bcc7-10a47fe1cf36 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.867698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4493c-1a1c-466b-bcc7-10a47fe1cf36 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.869531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 50/103] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:40.875343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92855-6bca-4590-8f28-84eb3d34eac9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:40.875898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92855-6bca-4590-8f28-84eb3d34eac9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:40.876363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad92855-6bca-4590-8f28-84eb3d34eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:40.916776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bad92855-6bca-4590-8f28-84eb3d34eac9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:40.918366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bad92855-6bca-4590-8f28-84eb3d34eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:40.967020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.004705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:41.011217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618538ad-29b1-492d-b1a0-fe4c8141a61d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.012342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618538ad-29b1-492d-b1a0-fe4c8141a61d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.012890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618538ad-29b1-492d-b1a0-fe4c8141a61d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.014642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 52/105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:41.020784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.021331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.021799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.025599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85507-c197-493c-9f2e-d634b7db140e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.053705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:41.055258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:41.059237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.106690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.107357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.107991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.108280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.109083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:41.109398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:41.110941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:41.129718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 53/106] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:41.130331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.130822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 54/107] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:41.136538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.305320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ff067-8429-4191-bfb6-8016c666ad1f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.355378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99f105-f5b2-461a-9b84-61cba42a8bcc None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.417162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.417895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.418174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.418451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] PATH_INFO: `/v3/users/103b8ccd9a2b4c468fa0d7181155e444` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.419931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.420662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.420945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.421220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.431993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:41.432572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.433720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:41.435445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 54/108] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:41.441501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.464879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] RBAC: Authorizing `identity:get_user(user_id=103b8ccd9a2b4c468fa0d7181155e444)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:41.465533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.466516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:41.470616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 55/109] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/users/103b8ccd9a2b4c468fa0d7181155e444 => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:41.475466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.630755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4cce6-3f4c-4b7a-af30-786fd0966d48 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.646637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92ee5-5ca0-4bf5-83c6-d35d58bac446 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.689276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.690393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.690894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.691407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.693615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.694398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.694820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.695264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.696092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:41.697832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:41.732057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 55/110] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 12:59:41 2022] POST /identity/v3/projects => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 12:59:41.733690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.793079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.810328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:41.813520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:41.827797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:41.881685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b585e-c906-44a1-a291-e8a63b0d67c1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:41.960927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:41.961868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.962315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.962725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.965134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 56/111] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 12:59:41.966538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:41.977375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-40338362-3e25-4960-acec-1dcd1c0e46c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:41.983059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:41.984150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:41.985077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:41.987089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 56/112] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:41.988650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5a26-1c6d-4e3c-84d8-801887822cc6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:41.988990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5a26-1c6d-4e3c-84d8-801887822cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:41.989331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5a26-1c6d-4e3c-84d8-801887822cc6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:41.990731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 57/113] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:41.992385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f5a26-1c6d-4e3c-84d8-801887822cc6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.085910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.096337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d322a3-326c-45d2-acf3-dc320aba2b84 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.135616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f5a26-1c6d-4e3c-84d8-801887822cc6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.139406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.140069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.140349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.140625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.152533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:42.154483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-22c95020-f05b-49a1-abd8-cd2e5bb08f0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:42.158129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:42.164579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 57/114] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:42.165336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ece6a-e521-4853-b51f-1cabc32c591d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.165988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ece6a-e521-4853-b51f-1cabc32c591d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.165988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ece6a-e521-4853-b51f-1cabc32c591d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.165988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 58/115] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:42.165988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ece6a-e521-4853-b51f-1cabc32c591d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.183491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.184148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.184431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.184707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.185933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.187477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611b0-e17c-4339-b0d6-d037e77eaf49 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.189169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 58/116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:41 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.190487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.190774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.191050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.213768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:42.215087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:42.292455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 59/117] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:42.292914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ece6a-e521-4853-b51f-1cabc32c591d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.293870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.333142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.333810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.334108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.334405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.335061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:42.335468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.337118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f53e2c-a6b3-4367-8f6f-1ed40d2fad25 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.351343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 59/118] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.351343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.351343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.351343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.368309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:42.369426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:42.387712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.412097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811eb7d-ce1c-4742-b8a8-0de5acbdddec None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.430407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.450987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.456221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.456756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.457200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.458183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:42.458769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.460528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.467653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 60/119] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:42.469043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.470796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 60/120] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.471937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.592138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af7cc4-0ce0-443b-9f58-e8a609e129c6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.632115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.633133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.633581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.634077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.635477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.637214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.639243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 61/121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.640266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.642351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860d8ea-0fdf-46ca-9d5a-3cb393c10633 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.681239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.681875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.682156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.682431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.683199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=103b8ccd9a2b4c468fa0d7181155e444) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:42.683680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.686314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.692912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.694160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 61/122] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/role_assignments?user.id=103b8ccd9a2b4c468fa0d7181155e444&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.695360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.709329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:42.776913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07324-bfb7-4010-8f1a-cc81054630f1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.828049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.828861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.829141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.829413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.830989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:42.833416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:42.836187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 62/123] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:42.837506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.843843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c54f7-5c0a-4bfc-9d76-908e2cf0aa5d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:42.898729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:42.899339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:42.899624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:42.899903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:42.917751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:42.925560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:42.926440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:42.927159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:42.928260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 62/124] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:42.929027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:42.978774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92e1d3-48f1-41c3-9481-2c4534cd038f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.003705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.026213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.026993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.027462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.027742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.029327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.030399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.032232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.034265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 63/125] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.035371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.075384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ab8cc-00f4-4087-85a7-b040c581d9e4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.128532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.129329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.129614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.129761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.145760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:43.153146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:43.154363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:43.155282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 63/126] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 12:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:43.161126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.170416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968a944-d029-4de5-ab3a-f801d965e6d7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.209453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.210476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.210950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.211482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.212881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.214730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.216957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 64/127] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.223029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.288455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199b25-d5d8-423c-9b02-0e3a036eb5bb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.289107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.320214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.330364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.331380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.331850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.332307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.333166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:43.333685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.335373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.345485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 64/128] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.346686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.349482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987c3ff-7936-4bcb-844f-32e1ff14cd67 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.395918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.396679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.396890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.397179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.399298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, user_id=bd9326dd9b2d45b3bd97273a5c20fde4, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.400894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.421597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 65/129] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:43 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:43.422659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.491597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0f30b-c94e-4bc9-b126-d6ba49a635c6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.536313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.537793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.538456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.539122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.540411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:43.540949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.542675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.544172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686dede-5029-4e04-8e94-3e8a09dacfb2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.556886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.558067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 65/130] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.560116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.593072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.594248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.594706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.595165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/91ee51bf97df4d1480625733920e3461/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.597419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, user_id=91ee51bf97df4d1480625733920e3461, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.599022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.621716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 66/131] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:43 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/91ee51bf97df4d1480625733920e3461/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:43.622704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.628765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:43.740481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0824-ae11-463e-892a-2e5dd383ddb3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.787903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.788574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.788856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.789130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.792587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.795165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.798071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 66/132] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.812316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:43.833541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a65df9-dd1f-482c-9685-12184e551fb6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:43.897651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:43.898343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:43.898628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:43.898917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:43.901590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:43.903367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:43.906610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 67/133] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:43.915174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:44.012964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:44.072652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0fd0-e2cf-47bd-9303-672f7615edfa None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:44.129217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:44.157293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:44.157952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.158236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.158509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] PATH_INFO: `/v3/projects/e07e99170e4341dda95f14e72d50ed79` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.160104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] RBAC: Authorizing `identity:get_project(project_id=e07e99170e4341dda95f14e72d50ed79)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:44.161745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:44.163448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 67/134] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/projects/e07e99170e4341dda95f14e72d50ed79 => generated 312 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:44.171059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:44.172099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b547-5fe8-47ce-bc85-8288f7e18ed3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:44.270882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:44.271493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.271776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.272050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.275924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:44.277420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:44.279845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 68/135] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:43 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:44.285580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:44.371241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5a211-96fa-44ea-b2bb-1b0a579e201b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:44.454016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:44.454719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.455005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.455311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] PATH_INFO: `/v3/projects/e07e99170e4341dda95f14e72d50ed79/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.460747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] RBAC: Authorizing `identity:create_grant(project_id=e07e99170e4341dda95f14e72d50ed79, user_id=bd9326dd9b2d45b3bd97273a5c20fde4, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:44.462574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ce5dc-0556-44e4-b73a-3014b4b3851e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:44.491591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbea07-7777-46d5-9720-cb5b6eaa795f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:44.501844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:44.502777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 68/136] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:44 2022] PUT /identity/v3/projects/e07e99170e4341dda95f14e72d50ed79/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 12:59:44.503968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f9c1-304a-4048-9be3-89f9ce694b38 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.504254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f9c1-304a-4048-9be3-89f9ce694b38 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.504528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f9c1-304a-4048-9be3-89f9ce694b38 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.510327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 69/137] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:44.529211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43357-d970-46fc-9cd6-b4d50d26e83c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.529506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43357-d970-46fc-9cd6-b4d50d26e83c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.529858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43357-d970-46fc-9cd6-b4d50d26e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.554191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:44.555422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:44.555897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:44.556386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:44.559074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, user_id=bd9326dd9b2d45b3bd97273a5c20fde4, role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:44.560905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:44.572707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6bd43357-d970-46fc-9cd6-b4d50d26e83c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:44.574455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6bd43357-d970-46fc-9cd6-b4d50d26e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:44.592209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 69/138] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:44 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/bd9326dd9b2d45b3bd97273a5c20fde4/roles/56a6a91609874159a6cf397498dea0cd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:44.690546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:44.725521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:45.154346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:45.378604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e1d5-f0db-4c45-9554-6021ced5bfe9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:45.423739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151fd-1f3d-4f0a-8445-da7ede8fdcba None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:45.424331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151fd-1f3d-4f0a-8445-da7ede8fdcba None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:45.424331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151fd-1f3d-4f0a-8445-da7ede8fdcba None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:45.425578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 71/140] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:45.430798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:45.431101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:45.431393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:45.447305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:45.448878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:45.449669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:45.450431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:45.450905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:45.453474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:45.455454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:45.458600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:45.461947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 70/141] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:45.468443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:45.599519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:45.649604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 72/142] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:45.741016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6e23-5de3-4796-94f8-576c451e30ba None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:45.793342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:45.793971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:45.794383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:45.794664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:45.795484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:45.797025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afef58a-384a-408b-a94a-2d848e7b07dc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:45.844876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 71/143] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:45 2022] POST /identity/v3/users => generated 283 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:46.202443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:46.291280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6c7d-98e4-40e3-bb26-4f87987eb716 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.291621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6c7d-98e4-40e3-bb26-4f87987eb716 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.291839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6c7d-98e4-40e3-bb26-4f87987eb716 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.293579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 72/144] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:46.305504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4002a-1888-4cfb-8268-d0e2e7fefee1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.305905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4002a-1888-4cfb-8268-d0e2e7fefee1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.306178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4002a-1888-4cfb-8268-d0e2e7fefee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.332016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4bf64-643d-4589-ab54-80e33e4b502f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:46.344305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-50f4002a-1888-4cfb-8268-d0e2e7fefee1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:46.345799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:46.346831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-50f4002a-1888-4cfb-8268-d0e2e7fefee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:46.374749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:46.375506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.375790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.376059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.393681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-0c8b57a6-8328-4190-a2ba-a3af0dacc322 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:46.401204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:46.402216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:46.402962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:46.404526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 73/145] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:46.407204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87420-d2a8-44be-a91e-d97f2ce76acd None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.407204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87420-d2a8-44be-a91e-d97f2ce76acd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.407204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87420-d2a8-44be-a91e-d97f2ce76acd None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.412369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 74/146] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:46.413195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f87420-d2a8-44be-a91e-d97f2ce76acd None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:46.459701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 73/147] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:46.463951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.464227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.464496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.485154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:46.486359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:46.502408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:46.547318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f87420-d2a8-44be-a91e-d97f2ce76acd None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:46.562409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 74/148] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:46.589045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:46.590063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.590603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.591067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.592012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:46.592518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:46.594223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:46.606789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 75/149] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:46.620686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:46.758446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed8d78-1a95-42b2-89c1-2264e3d6a31f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:46.797246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:46.797914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:46.798192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:46.798465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] PATH_INFO: `/v3/users/103b8ccd9a2b4c468fa0d7181155e444` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:46.799827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] RBAC: Authorizing `identity:get_user(user_id=103b8ccd9a2b4c468fa0d7181155e444)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:46.801327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:46.803375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 75/150] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:46 2022] GET /identity/v3/users/103b8ccd9a2b4c468fa0d7181155e444 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:46.810281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:46.867338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:46.940056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:46.960621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583644b2-8a1d-4748-b78c-f750c5505cad None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:46.968368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.016531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b502b-cff6-4804-912a-82d6902103af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.017582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b502b-cff6-4804-912a-82d6902103af None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.018135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b502b-cff6-4804-912a-82d6902103af None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.018573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b502b-cff6-4804-912a-82d6902103af None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.021079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b502b-cff6-4804-912a-82d6902103af None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.022808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b502b-cff6-4804-912a-82d6902103af None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.024794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 76/151] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:46 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:47.031494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b502b-cff6-4804-912a-82d6902103af None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.067547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69726f-4d85-40d8-8cba-c5a25e1f69ed None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.114723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.115530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.115884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.116233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.128820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:47.134023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:47.135549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 76/152] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:47.137504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.148397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.153074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b502b-cff6-4804-912a-82d6902103af None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.190993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.191847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.192197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.192529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/103b8ccd9a2b4c468fa0d7181155e444/roles/06d85bf36b0b4646918c25bd5cbdd8c2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.194611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, user_id=103b8ccd9a2b4c468fa0d7181155e444, role_id=06d85bf36b0b4646918c25bd5cbdd8c2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.196228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.214650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 77/153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:47 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/users/103b8ccd9a2b4c468fa0d7181155e444/roles/06d85bf36b0b4646918c25bd5cbdd8c2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 12:59:47.215669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.228840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.254732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53b51e-5009-48fb-9bb5-3d7f49ed1676 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.301132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.301977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.302377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.302745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.315503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:47.320757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:47.321683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:47.322804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 77/154] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:47.328555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.417821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9214d-ea69-483b-aec8-9842a91a5233 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.461031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.461668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.461951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.462278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.462989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:47.463366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.464825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210f3f-55b8-4b18-87ea-6a69abd4a828 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.475889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 78/155] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:47.477841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908592e-af01-4741-a77a-bf6a0436bf54 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.478275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908592e-af01-4741-a77a-bf6a0436bf54 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.478760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908592e-af01-4741-a77a-bf6a0436bf54 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.480286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 79/156] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:47.488512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.489048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.489471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.501980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa707af-4aa7-48c4-ac10-a81145a43356 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.512610 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:47.514173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:47.531924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.546594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.547599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.548069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.548537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.549444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:47.549956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.551765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.558998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.562831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 78/157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:47.563994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.600846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 80/158] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:47.603281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.692366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facf45-7215-4108-ad4d-baa75b721bff None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.720661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09246639-0769-485f-b23e-67c77ae7bd89 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.730055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.731117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.731632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.732095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.733632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.735357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.737282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 79/159] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:47.744133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.798556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.799261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.799547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.799819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] PATH_INFO: `/v3/users/91ee51bf97df4d1480625733920e3461` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.801475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] RBAC: Authorizing `identity:get_user(user_id=91ee51bf97df4d1480625733920e3461)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.803021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:47.804731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 81/160] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/users/91ee51bf97df4d1480625733920e3461 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:47.832291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.837647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:47.874605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed04e9c-9f00-4b98-a230-4c716c0dcbd4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:47.876795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:47.916872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:47.917503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:47.917872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:47.918155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:47.998165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:47.999739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:48.083615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:48.116925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 80/161] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:48.122673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:48.185266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c37f4-6758-4d6e-b23c-e0e9bf63c37c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:48.258783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:48.259583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.259874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.260144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.342035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:48.343580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:48.364434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:48.449181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ae1f1-745b-451d-8421-945a58b4eec3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:48.454354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 82/162] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:48.455085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:48.572285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7da56-1d56-4f0d-8d3d-c81d076cd04f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:48.592898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:48.604846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:48.605524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.605788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.606065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.615460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:48.615460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:48.617428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 81/163] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:48 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:48.618463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:48.620105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:48.620891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.621271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.621629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.635546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:48.641682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:48.642695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:48.643519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:48.644093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 83/164] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:48.647910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:48.727573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:48.844085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f08b9-c525-43d3-83ef-1e9f3822f04c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:48.877779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43d3b-a30a-4d90-89af-eb78fa6fcf75 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:48.913350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:48.914128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.914411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.914682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.915458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:48.915769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:48.919204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:48.924633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 84/165] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:48 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:48.925645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:48.966852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:48.967973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.968612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.969568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.971295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:48.973166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c7e90-e553-4eb5-bc24-d4686ed04e96 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:48.975121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 82/166] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:48 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:48.976606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77771-9084-4261-b12d-3506769f66b2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.977083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77771-9084-4261-b12d-3506769f66b2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.977572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed77771-9084-4261-b12d-3506769f66b2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:48.983215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 83/167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:48.989305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:48.989862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:48.990336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:49.003208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:49.020728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:49.022269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:49.055738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2ca7-d46d-4db4-a434-b5eafd8861dd None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:49.163803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:49.164365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:49.164650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:49.164929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:49.165710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:49.165932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:49.167468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:49.187145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 85/168] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:49.187900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:49.212468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 84/169] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:49.213713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:49.276024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:49.411124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e31060-7eb6-4eee-8295-cc0c43affe25 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:49.413905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:49.445485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b142b-59e3-4e17-b179-e8e92f259f44 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:49.461767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:49.462412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:49.462692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:49.462962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:49.463833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=91ee51bf97df4d1480625733920e3461) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:49.464071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:49.465640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:49.472449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 86/170] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:49 2022] GET /identity/v3/role_assignments?user.id=91ee51bf97df4d1480625733920e3461&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:49.488454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:49.489271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:49.489647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:49.490015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:49.491353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:49.492964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:49.495248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 85/171] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:49 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:49.501501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:49.677948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353283f-d726-4aa3-978a-c940709342cb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:49.731361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:49.732003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:49.732283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:49.732589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:49.733913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:49.807560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:49.908104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9b13-f2e6-4277-adb1-b800e1a90d17 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:49.908338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:49.909857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:49.909965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:49.970720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:49.971769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:49.972261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:49.972742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.002084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:50.020334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:50.021338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:50.022091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:50.023161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 86/172] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 12:59:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:50.029827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:50.164914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36d224-0461-470e-81da-529ab0cf3bc1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:50.201535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:50.202167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.202448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.202723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.203498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:50.203733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:50.205165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4172f61-34ee-4c86-bc2a-9691436bfa9b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:50.214478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 87/174] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 12:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:50.214661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 87/174] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:50.215656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9227-2a7d-4813-8be5-c9c26ed102d3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.215938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9227-2a7d-4813-8be5-c9c26ed102d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.216394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9227-2a7d-4813-8be5-c9c26ed102d3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.217609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 88/175] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:50.220318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:50.224254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9227-2a7d-4813-8be5-c9c26ed102d3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:50.251535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:50.337104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9227-2a7d-4813-8be5-c9c26ed102d3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:50.371899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:50.372540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.372823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.373140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] PATH_INFO: `/v3/projects/e07e99170e4341dda95f14e72d50ed79` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.374275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] RBAC: Authorizing `identity:get_project(project_id=e07e99170e4341dda95f14e72d50ed79)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:50.375757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850b45b-31d2-428d-9c78-a0e91ca4dcdf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:50.377575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 89/176] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:50 2022] GET /identity/v3/projects/e07e99170e4341dda95f14e72d50ed79 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:50.378577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.378899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.379118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.397935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:50.399222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:50.408523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:50.470742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 90/177] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:50.471438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:50.499551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:50.513364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c671ca6-833c-41fb-9d3a-ed42b33a863b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:50.584442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:50.585095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.585377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.585641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] PATH_INFO: `/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.588642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] RBAC: Authorizing `identity:get_user(user_id=bd9326dd9b2d45b3bd97273a5c20fde4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:50.591481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:50.594931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 88/178] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:50 2022] GET /identity/v3/users/bd9326dd9b2d45b3bd97273a5c20fde4 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:50.604874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:50.618557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf7287-1cc2-48be-912f-99aabe467890 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:50.654934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:50.655577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.655854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.656122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.656863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=e07e99170e4341dda95f14e72d50ed79, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:50.657170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:50.658649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc409482-1cd4-498b-8f71-e6a9315a4038 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:50.665089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 91/179] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:50 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=e07e99170e4341dda95f14e72d50ed79&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:50.666183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704027ed-0c7a-4bac-942c-687ea7add2eb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.666510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704027ed-0c7a-4bac-942c-687ea7add2eb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.666731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704027ed-0c7a-4bac-942c-687ea7add2eb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.668014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 92/180] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:50.673891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a560-a5d5-499c-90ca-a5847d0f6281 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.674184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a560-a5d5-499c-90ca-a5847d0f6281 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.674483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a560-a5d5-499c-90ca-a5847d0f6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.694281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7d59a560-a5d5-499c-90ca-a5847d0f6281 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:50.695563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7d59a560-a5d5-499c-90ca-a5847d0f6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:50.860579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 93/181] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:50.862766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a374f-1e3e-473c-8188-7ec432f392e6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.863316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a374f-1e3e-473c-8188-7ec432f392e6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.863803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a374f-1e3e-473c-8188-7ec432f392e6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.866710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 94/182] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:50.868721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295e376-7c8e-4a05-8c95-663a68b00ddc None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:50.878157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.879076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.879438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.911349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:50.912146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:50.927393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:50.928360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:50.928865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:50.929763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:50.934789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:50.941624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.020073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 95/183] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:51.021356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.030704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:51.033228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2394a-5f53-4760-b7e8-4fbb3299aba9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:51.205822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 89/184] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:51.207153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f0fd-cf8e-4b9c-b1f1-3751fc6871a7 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.207458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f0fd-cf8e-4b9c-b1f1-3751fc6871a7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.207731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f0fd-cf8e-4b9c-b1f1-3751fc6871a7 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.209092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 90/185] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:51.210233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d8262-0662-43c8-9359-a6a9e3f4f450 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.213298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f0fd-cf8e-4b9c-b1f1-3751fc6871a7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.254277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.258760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.259749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.260217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.260684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.273075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:51.278181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:51.279715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:51.280488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 96/186] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:51.281153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.293529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.338574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f0fd-cf8e-4b9c-b1f1-3751fc6871a7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.374554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.375230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.375511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.375787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.376949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:51.378427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f28462-fc8a-483a-9406-0207d9e25858 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:51.380319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 91/187] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:51.381312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.381591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.381857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.400544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:51.401889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:51.408833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312035-7bca-41e8-87a7-1711706ad167 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.445553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.446195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.446470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.446739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.459630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:51.464441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:51.465519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 97/188] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:51.467907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.480666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 92/189] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:51.487749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.521180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.552039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.593861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68610a91-6acc-4167-93aa-e4b30ef008d7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.611678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d61421-ca2c-4ccf-a834-c5c62dcf07d4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.635163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.636134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.636807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.637247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.638120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:51.638491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:51.640269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:51.651286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 98/190] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:51.654091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.654793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.655069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.655362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.658413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.667225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:51.672131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:51.675367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 93/191] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:51.676212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.780589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74bd8-7211-497e-91d9-4a0d80315529 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.788069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.795749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7946-264c-4b2a-aa7b-cc704040c192 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.810141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:51.820382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.820999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.821279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.821555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.822294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=bd9326dd9b2d45b3bd97273a5c20fde4) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:51.822607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:51.824098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:51.830765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 99/192] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/role_assignments?user.id=bd9326dd9b2d45b3bd97273a5c20fde4&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=56a6a91609874159a6cf397498dea0cd => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:51.831593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.836521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:51.837158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:51.837557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:51.837557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:51.838529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:51.838837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:51.840484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:51.849956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 94/193] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:51.850827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:51.965709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eb38c-1f5a-4a9e-9215-73ee97c5e7b9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:51.977806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142ca5-8e7e-48c7-91f8-80ace3237910 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.014956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.015641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.015918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.016189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] PATH_INFO: `/v3/users/103b8ccd9a2b4c468fa0d7181155e444` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.017384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=103b8ccd9a2b4c468fa0d7181155e444)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.018856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.020265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.020526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 100/194] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/users/103b8ccd9a2b4c468fa0d7181155e444 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:52.020899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.021178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.021288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.021513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.022132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:52.022434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.023887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.034919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 95/195] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:52.035722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.063222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.104545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.151659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0582a-261b-4862-b6c5-ae9d58af1fd0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.165110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ea78-4771-4351-bf76-1b6fad7c62cb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.190044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.190653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.190943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.191236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.192342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.193782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.195383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 101/196] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:52.201160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.206546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.207396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.207675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.207944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.223054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.224713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.226634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 96/197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:52.227239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.308582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277fa4d-63ca-4b42-9a3b-858367b63906 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.310243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.337429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eb66f-498d-49c2-a23b-43b05e16bb0b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.339283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.347440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.348058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.348331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.348598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.375164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.375840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.376115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.376395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.377549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.379023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.380662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 97/198] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:52.381400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.432133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.433639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.511924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f823e-80b1-4d83-aefa-b36a7d6a2451 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.548526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.549156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.549477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.549744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.550411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.551899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.564626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 102/199] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:52.564626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.575389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.580502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 98/200] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:52 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 12:59:52.584239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.590749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.679451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a86e8-c2ae-437e-b969-2109285f7d50 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.718962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.719901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.720447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.720722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.728428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114968-271d-4355-b60d-11e2c20c6fe0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:52.768540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:52.769165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:52.769440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:52.769710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:52.801383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.801383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.833034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.858778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:52.861995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:52.863594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:52.930898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 103/201] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:52.932439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:52.987802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 99/202] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:52.992039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:53.082038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0ffde-009b-47b6-a5a0-3daa14d7b226 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.103488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:53.112713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962fc6d-9780-40b7-b885-0b9571e9d93a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.122980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:53.139683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.141169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.142039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.143158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.146218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.149907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.154481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 104/203] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:53.156054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:53.159708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.160508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.161038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.161352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.163812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.164435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.170507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 100/204] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:52 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:53.170507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:53.285849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308bad-b1a0-47aa-ae0f-05aee6242bfe None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.320704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4a57e-a6c5-454b-8538-c8fa2d285450 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.321970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.322765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.323209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.323641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.324519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, scope.project.id=1874aa7556d94cd1a5e671aefe930726, user.id=103b8ccd9a2b4c468fa0d7181155e444) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:53.324957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.331790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.338974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 101/205] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:53 2022] GET /identity/v3/role_assignments?user.id=103b8ccd9a2b4c468fa0d7181155e444&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:53.340416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:53.379623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:53.398462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.399321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.399740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.400115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.402101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.404349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.411218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 105/206] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:53 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:53.426523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:53.505416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:53.513252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19785cdb-ab62-4088-86fd-fc44d3496ec7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.574080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.575152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.576892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.577586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.578841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=729a419d86354b9dbe6ab69a7da841eb) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:53.579994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.582283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36ef51-9248-4937-95ca-b5c3dfcfc2a9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.586633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8d53-8da8-45b1-baeb-27d130ded4d3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:53.599601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 102/207] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:53 2022] GET /identity/v3/role_assignments?user.id=729a419d86354b9dbe6ab69a7da841eb&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=56a6a91609874159a6cf397498dea0cd => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:53.664350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:53.664912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:53.665191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:53.665465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:53.666227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=729a419d86354b9dbe6ab69a7da841eb) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:53.666531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:53.668124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0566bb-81d4-494e-b7b1-8cca5ef1df58 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:53.685781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 106/208] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:53 2022] GET /identity/v3/role_assignments?user.id=729a419d86354b9dbe6ab69a7da841eb&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:54.668175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bb2d-f450-455d-b90f-de84c53ce21b None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:54.668710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bb2d-f450-455d-b90f-de84c53ce21b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:54.668710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bb2d-f450-455d-b90f-de84c53ce21b None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:54.670162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 103/209] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:54.675985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:54.676452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:54.676717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:54.695422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:54.696635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:54.756282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d88e-c1a8-4ec3-8411-c0cb82145c61 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:54.756637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d88e-c1a8-4ec3-8411-c0cb82145c61 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:54.756867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d88e-c1a8-4ec3-8411-c0cb82145c61 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:54.758368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 104/210] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:54.763789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:54.764071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:54.764346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:54.778943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:54.792284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:54.793840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:54.884559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:55.090503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.150654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.163713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.179840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.210961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ccd2e-53ef-4e5f-bde3-7225f8ce787e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.248197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.249235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.249700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.250241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.256863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b80a39-24f9-4314-b49b-ede9911c3366 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.262729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:55.268364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:55.269226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:55.269985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:55.272783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 108/213] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:55.279466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.293927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.294517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.294833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.295105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.296561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:55.298241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:55.303262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 106/214] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:55.306428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.422235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b77c-a6ee-43da-8e19-50fd0d738747 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.432364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.439541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d23b9f-de14-47e7-b8fc-a901b6919c0d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.444065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.463838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.464820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.465292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.465753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.466676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:55.467170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:55.468782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:55.477743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.478359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.478687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.478957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.479512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 109/215] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:55.480887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:55.482677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:55.486821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.523338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 107/216] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:55 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 12:59:55.621647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586ac0-f22c-4604-a1eb-a8de943778e5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.663302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.664477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.664947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.665404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] PATH_INFO: `/v3/users/e7b34e8e44e24f468c52c37f92814e62` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.692358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b34e8e44e24f468c52c37f92814e62)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:55.694719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fb703-2bc7-4bd9-9322-0d7a4bba6d04 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:55.697183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 110/217] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:55 2022] GET /identity/v3/users/e7b34e8e44e24f468c52c37f92814e62 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:55.703363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:55.731643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d827-a156-43d8-ab41-99029ff65b49 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.731949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d827-a156-43d8-ab41-99029ff65b49 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.732226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d827-a156-43d8-ab41-99029ff65b49 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.733937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 111/218] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 12:59:55.739702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda42a-7a68-4067-8b83-7773d0a1b2e7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.739997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda42a-7a68-4067-8b83-7773d0a1b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.740253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cda42a-7a68-4067-8b83-7773d0a1b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.764798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-13cda42a-7a68-4067-8b83-7773d0a1b2e7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:55.766226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-13cda42a-7a68-4067-8b83-7773d0a1b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:55.814021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.843175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803fe9-1f5c-4e05-afe4-4ee025c44c5c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:55.867049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 112/219] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 12:59:55.868433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677e48-2783-4529-b6d1-3170d9eca356 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.868720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677e48-2783-4529-b6d1-3170d9eca356 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.868999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677e48-2783-4529-b6d1-3170d9eca356 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.870313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 113/220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:55.876410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.876700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.877031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.895889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:55.896525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:55.896812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:55.897087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:55.904394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:55.905627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:55.925482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:55.998366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 114/221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:56.015560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:56.018089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:56.164613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.168866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 108/222] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:56.174184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.262257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:56.328063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:56.332438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbf29b-c580-4330-a2d8-f244234586e7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.332815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc091d-188b-4f10-83e5-d7fc2ae63493 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.373422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.374079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.374356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.374630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.376652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.377524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.378210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.378487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.379688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:56.381518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:56.384239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 109/223] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:56.384863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.391804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:56.397189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:56.398108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 12:59:56.399347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 115/224] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:56.400161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.501328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ac5b-c963-45de-875e-a0a7dc119857 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.522005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:56.539154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3be71-182a-48e1-a378-1435ec12376f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.541338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.542264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.542739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.543222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.554916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:56.560209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:56.561117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 12:59:56.561866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:56.564150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 110/225] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:56.565326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.581167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.581790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.582069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.582342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.583277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=e7b34e8e44e24f468c52c37f92814e62) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:56.583597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:56.585186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:56.592811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 116/226] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/role_assignments?user.id=e7b34e8e44e24f468c52c37f92814e62&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:56.593847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.639638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:56.690580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378986d-4e61-42ef-9a5a-acc83c4624ae None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.728538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.729390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.729761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.730160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.730936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:56.731365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:56.732941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:56.742668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 111/227] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:56.752580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.832424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8c103-33fc-4885-84fc-fc50315c9a1d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:56.851762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:56.889956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:56.890958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:56.892465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:56.892942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:56.893849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:56.899676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:56.901447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:56.920632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 117/228] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:56.923521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:56.962382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e1e9-5470-4542-87a8-3e4b51069c06 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.042192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.043292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.043894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.044366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.046411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.048275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.052309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 112/229] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:57.066130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:57.086841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:57.120874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fa0ee-82e6-42a1-8ae1-fe838423694e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.172598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.173255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.173604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.173871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.175069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.177328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.179049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 118/230] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:56 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:57.188776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:57.295819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fec95-dc67-439b-b4cb-15198fe69fe9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.308549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:57.365716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6f695-c7c9-49d3-8ec4-1ea0a3b6d29e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.383531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.384294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.384568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.384836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.387208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.390006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.392470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 113/231] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:57 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:57.400320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:57.429825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.430757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.431365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.431847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.443094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.444642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.446918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 119/232] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:57 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 12:59:57.453592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:57.492988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:57.619214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64545-78e9-4992-9f78-2573c09dd54b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.669400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2c3b-9d30-496d-ad5d-216f2293d1a2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:57.695611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.696304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.696586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.696865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/729a419d86354b9dbe6ab69a7da841eb/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.701441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, user_id=729a419d86354b9dbe6ab69a7da841eb, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.702943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da4600-6a5d-460f-8092-ffcc074b6687 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.735345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 114/233] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:57 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/729a419d86354b9dbe6ab69a7da841eb/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:57.746365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:57.747057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:57.747399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:57.747724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/729a419d86354b9dbe6ab69a7da841eb/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:57.750039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, user_id=729a419d86354b9dbe6ab69a7da841eb, role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:57.751640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228f6b2-0791-4c18-9cc0-fc4fb6e4e3e0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:57.791118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 120/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 12:59:57 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/729a419d86354b9dbe6ab69a7da841eb/roles/56a6a91609874159a6cf397498dea0cd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 12:59:58.003572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338fdc-8834-482f-a67b-710146506948 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.003964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338fdc-8834-482f-a67b-710146506948 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.004161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af338fdc-8834-482f-a67b-710146506948 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.005819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 115/235] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:58.012125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edc24-76a0-4566-82a2-6ff33aa9d245 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.012764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edc24-76a0-4566-82a2-6ff33aa9d245 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.012764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edc24-76a0-4566-82a2-6ff33aa9d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.034658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3e5edc24-76a0-4566-82a2-6ff33aa9d245 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:58.035981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3e5edc24-76a0-4566-82a2-6ff33aa9d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:58.128606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 121/236] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:58.164788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc398-6402-42b3-a8db-8d8ae30ce0b9 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.165102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc398-6402-42b3-a8db-8d8ae30ce0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.165334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dc398-6402-42b3-a8db-8d8ae30ce0b9 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.166969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 116/237] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:58.173300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.174148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.174862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.203498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:58.205911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:58.211135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:58.299628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 122/238] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:58.433476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc398-6402-42b3-a8db-8d8ae30ce0b9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:58.486147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:58.589137 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dc398-6402-42b3-a8db-8d8ae30ce0b9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:58.627537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:58.644155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:58.644811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.645084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.645350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.664590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:58.673498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:58.674395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:58.675152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 117/239] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:58.683379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:58.799250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2590f5-45f7-49f6-accb-753947a76f20 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:58.807529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153478d-fe1d-43a2-b5e1-79d5579f9bfe None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:58.827467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:58.840347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:58.841319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.842050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.842609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.843987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:58.844535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:58.847299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:58.862346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 118/240] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:58.874280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:58.884981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:58.885801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:58.886308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:58.886561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:58.887826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:58.889458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:58.899687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 123/241] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 12:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:58.905383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:58.929803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.035265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f1d0-3d30-4e7f-9200-ecac8cf9991c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.096058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.097200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.098138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.098943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] PATH_INFO: `/v3/users/f7028ce3787f431790820d4d37487a2b` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.108072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eee555-6a7f-45f3-ad18-985398c9c60a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.119650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=f7028ce3787f431790820d4d37487a2b)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:59.122972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e463d43-4eb7-452a-be01-f7b502590ea9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:59.127521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 119/242] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 12:59:58 2022] GET /identity/v3/users/f7028ce3787f431790820d4d37487a2b => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:59.130384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111598a7-4c2c-4b9e-a13a-2f3d04e2b121 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.131509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111598a7-4c2c-4b9e-a13a-2f3d04e2b121 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.132192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111598a7-4c2c-4b9e-a13a-2f3d04e2b121 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.134195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 120/243] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 12:59:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 12:59:59.135850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111598a7-4c2c-4b9e-a13a-2f3d04e2b121 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:59.158546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.158880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.160141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.160925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.161345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.162203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:59.164631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cabbd-0b99-43ca-9fbf-5ed2f5d6472c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:59.195251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 124/244] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 12:59:58 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 12:59:59.197668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.198267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.199391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.228772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 12:59:59.230402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 12:59:59.292482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111598a7-4c2c-4b9e-a13a-2f3d04e2b121 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.352781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.378871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 125/245] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 12:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 12:59:59.387498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.388548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.389008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.389423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.465025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:59.466883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:59.485969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.602698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 121/246] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 12:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 12:59:59.610037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:59.667466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:59.735623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038e2a-a0a9-4549-8f4e-4ec42c80082e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.774157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.775386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.775856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.776312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.777754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:59.780726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:59.782816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 126/247] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 12:59:59 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 12:59:59.789261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:59.801793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e8f07-0376-4eb2-8d8d-85515b0c6c6f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.824233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.844677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.845344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.845624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.845896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.860565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 12:59:59.864022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 12:59:59.868211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 12:59:59.869451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 12:59:59.870213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 122/248] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 12:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 12:59:59.885143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 12:59:59.932992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef271d3-3950-49c1-82d0-5130bdee2c09 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 12:59:59.984672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 12:59:59.985303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 12:59:59.985581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 12:59:59.985854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 12:59:59.986944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=f7028ce3787f431790820d4d37487a2b) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 12:59:59.988231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 12:59:59.989739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 12:59:59.997150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 127/249] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 12:59:59 2022] GET /identity/v3/role_assignments?user.id=f7028ce3787f431790820d4d37487a2b&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:00.041614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0019db2-03e0-4148-8c86-db162572ebcf None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:00.088098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:00.089078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.089519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.089968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.090816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:00.091282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:00.092933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:00.104741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 123/250] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 12:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:00.111062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:00.254501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae757a66-7aca-4b85-a1f3-8a7f38910ea3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:00.282948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:00.291963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12282cb-5148-412b-9470-60100b6690de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:00.292710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12282cb-5148-412b-9470-60100b6690de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.292997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12282cb-5148-412b-9470-60100b6690de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.293262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12282cb-5148-412b-9470-60100b6690de None admin] PATH_INFO: `/v3/users/e7b34e8e44e24f468c52c37f92814e62` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.294768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12282cb-5148-412b-9470-60100b6690de None admin] RBAC: Authorizing `identity:get_user(user_id=e7b34e8e44e24f468c52c37f92814e62)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:00.296448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12282cb-5148-412b-9470-60100b6690de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:00.301072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 128/251] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:00 2022] GET /identity/v3/users/e7b34e8e44e24f468c52c37f92814e62 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:00.304508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:00.337308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b366dd-3a0f-49ea-a399-f7288cdaeac7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.337623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b366dd-3a0f-49ea-a399-f7288cdaeac7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.337852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b366dd-3a0f-49ea-a399-f7288cdaeac7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.339228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 129/252] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:00.346322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648d8a-0d08-41a4-8f97-2a8a052e2feb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.346616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648d8a-0d08-41a4-8f97-2a8a052e2feb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.346858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648d8a-0d08-41a4-8f97-2a8a052e2feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.372424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a8648d8a-0d08-41a4-8f97-2a8a052e2feb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:00.373664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a8648d8a-0d08-41a4-8f97-2a8a052e2feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:00.382647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:00.491873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc218f7-527b-4335-801f-2a24f25ca78e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:00.517960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 130/253] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:00.519636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186426-0e17-4736-a2c4-74ff44476680 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.519921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186426-0e17-4736-a2c4-74ff44476680 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.520195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186426-0e17-4736-a2c4-74ff44476680 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.521722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 131/254] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:00.532949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.533211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.533480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.558307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:00.559367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.559805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.560364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.562597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:00.565295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:00.568023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 124/255] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:00 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:00.576503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:00.585104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:00.586352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:00.721871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 132/256] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:00.775099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025108-2aa8-47ec-9c5a-6c1253c84817 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:00.787535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:00.827116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:00.827806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:00.828092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:00.828359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/e7b34e8e44e24f468c52c37f92814e62/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:00.830302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, user_id=e7b34e8e44e24f468c52c37f92814e62, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:00.831847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:00.854700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 125/257] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:00 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/e7b34e8e44e24f468c52c37f92814e62/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:01.053071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.071372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.163568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:01.250196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5955c-4c04-44f1-a889-c65236c432ef None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:01.277774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9723c-c4fb-4bcf-ad75-7f788a330402 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:01.329989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:01.330562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:01.330844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:01.331111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:01.353324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:01.358267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:01.359145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:01.359938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 133/258] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:01.366618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:01.367308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:01.367589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:01.367861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:01.377116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.387837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:01.398230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:01.399129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:01.399924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 126/259] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:01.416390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.488779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:01.633351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7ab9-9daf-49bd-ba11-df8893290596 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:01.665746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:01.685937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204fdb-67ea-48a2-af13-3a1957071842 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:01.718243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:01.719274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:01.719740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:01.720204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:01.721060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:01.721546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:01.723142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:01.738819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 134/260] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:01.744712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.752982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:01.754011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:01.759428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:01.759930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:01.760938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:01.761434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:01.763057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:01.775644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 127/261] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:01.781988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:01.932990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:01.947905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ecea-7b5f-41f6-9396-ca47a0031109 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:01.959484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285041c-c271-4400-a317-60a27bbd7602 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:02.000860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:02.001519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.001795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.002069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.012115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:02.013685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:02.015419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 135/262] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:02.022720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:02.068732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:02.069412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.069694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.069990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] PATH_INFO: `/v3/users/729a419d86354b9dbe6ab69a7da841eb` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.076086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] RBAC: Authorizing `identity:get_user(user_id=729a419d86354b9dbe6ab69a7da841eb)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:02.078541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:02.080703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 128/263] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:01 2022] GET /identity/v3/users/729a419d86354b9dbe6ab69a7da841eb => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:02.088163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:02.098047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:02.242928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ea836-4f0d-4198-af9f-e9ae9f95097d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:02.345957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:02.348794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.349669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.352169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.357365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5753a-f1b7-45e9-aa0e-2f540a2d0b94 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:02.443614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:02.444239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.444511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.444781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.491119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:02.523021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:02.524579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:02.571045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:02.573979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec0dc-61ea-4166-b89f-b7c6bf4f5d30 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:02.610783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:02.699972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 136/264] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:02.706417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:02.759252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 129/265] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:02.761484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef968-4571-4a80-8011-5fc4a677f6a3 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.761916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef968-4571-4a80-8011-5fc4a677f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.762340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fef968-4571-4a80-8011-5fc4a677f6a3 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.764688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 130/266] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:02.777681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.778058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.778756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.810961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:02.812236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:02.889037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1797b-21d7-402e-8755-03a3ed8c3173 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:02.923159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:02.946017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 131/267] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:02.946747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:02.956108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:02.957542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.957991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.958457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.960278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:02.962562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b8f9-4347-42d2-b0a9-81a3ae7979de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:02.965745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 137/268] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:02 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:02.967604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3b6d-d741-4add-8449-8ed3d043be42 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.968487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3b6d-d741-4add-8449-8ed3d043be42 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.968930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3b6d-d741-4add-8449-8ed3d043be42 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.975066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 138/269] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:02.976921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0c29-9703-438d-9017-cadc76864cde None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:02.977374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0c29-9703-438d-9017-cadc76864cde None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:02.977836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0c29-9703-438d-9017-cadc76864cde None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:02.979511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 139/270] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:02.980917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0c29-9703-438d-9017-cadc76864cde None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.000117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.063981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d589d-fd7c-40bf-ab0b-56e648370a8f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.103359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.104123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.104550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.104929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.106583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:03.109162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d55631-7dc8-49d4-b3c5-ac718f82aab5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:03.111001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 132/271] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:02 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:03.115552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.115552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.115552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.121910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0c29-9703-438d-9017-cadc76864cde None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.132471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:03.133855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:03.163856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.164914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.165691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.166376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.167498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=729a419d86354b9dbe6ab69a7da841eb) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:03.168060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:03.169844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0be2cb-e4fd-4314-ad6c-ff2015a8451b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:03.176796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 140/272] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:02 2022] GET /identity/v3/role_assignments?user.id=729a419d86354b9dbe6ab69a7da841eb&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:03.178484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.178643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.179025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.215076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:03.215566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.216339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:03.242376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 133/273] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:03.243623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.361886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 141/274] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:03.368187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.382461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.422023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36134c61-61f4-4d72-825f-fb362107a796 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.458892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.459849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.460325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.460786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.461693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=729a419d86354b9dbe6ab69a7da841eb) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:03.462170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:03.463903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:03.470830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 134/275] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/role_assignments?user.id=729a419d86354b9dbe6ab69a7da841eb&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=56a6a91609874159a6cf397498dea0cd => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:03.540135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e7f8-17e4-4bac-8817-947cc857d346 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.583114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.584209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.584706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.585151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.598639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:03.603755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:03.604621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:03.605391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:03.607953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 142/276] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:03.614268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.623211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.684955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.766964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17866870-5dac-406f-872d-383c4ed2b83c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.782727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.816965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.817599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.817877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.818147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.818824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:03.819127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:03.822624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:03.827951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d7f-135a-4edf-bc27-16651e4cf7bb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.830318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 135/277] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:03.831328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.866364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.866917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.867208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.867489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.878483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b2432d68-874d-41ea-bee7-25cb0a5d3e37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:03.883251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:03.884175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 143/278] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:03.890176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d1a-10bf-4251-9cbc-68931beace59 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.890873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d1a-10bf-4251-9cbc-68931beace59 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.890873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19d1a-10bf-4251-9cbc-68931beace59 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.890873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 144/279] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:03.890873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df19d1a-10bf-4251-9cbc-68931beace59 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.945664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fa07d-6873-4e8d-989c-f7490459b299 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:03.955974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:03.980325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:03.980967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:03.981249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:03.981517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:03.982673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:03.984213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:03.985804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 136/280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:03.986570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:03.997311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df19d1a-10bf-4251-9cbc-68931beace59 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.030588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.040096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.040734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.041010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.041277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] PATH_INFO: `/v3/users/b75ede8ed285407eac492c0223f7a863` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.055459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] RBAC: Authorizing `identity:get_user(user_id=b75ede8ed285407eac492c0223f7a863)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.056921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1df8ba-5da7-433f-9721-a67ff0bba070 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.058584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 145/281] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/users/b75ede8ed285407eac492c0223f7a863 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:04.059760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.060034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.060423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.077746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:04.079011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:04.091906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1431-fdb0-401d-8141-872a33bca017 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.132246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.132776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.133053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.133322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.133997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:04.134294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.135731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.145055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 137/282] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:04.145860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.154640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 146/283] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:04.155629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.189775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.252364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351cd5f-1961-4b21-9c93-7e05a72a2b2f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.282489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca988-a10c-4042-8536-fb177a4c4eb0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.287125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.287779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.288060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.288329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.288981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.290462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.307463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.320434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 138/284] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:04 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:04.321110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.349045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.350281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.350775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.351253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.352102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, user.id=b75ede8ed285407eac492c0223f7a863, scope.system=all) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:04.352662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.354826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.362906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 147/285] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/role_assignments?user.id=b75ede8ed285407eac492c0223f7a863&scope.system=all&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:04.433013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.468041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c190f6-50b1-4b8a-b7d9-8076853c7114 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.471641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.517560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.518230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.519375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.519375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] PATH_INFO: `/v3/users/f7028ce3787f431790820d4d37487a2b` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.520056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] RBAC: Authorizing `identity:get_user(user_id=f7028ce3787f431790820d4d37487a2b)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.521583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.523488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 139/286] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/users/f7028ce3787f431790820d4d37487a2b => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:04.529510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.567668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2e95b-be80-40e6-9e68-8f8112a9f2bf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.621249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.621249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.621249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.621249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.637027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:04.643575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:04.644465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:04.645374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 148/287] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:04.652625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.669687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd50bd-672c-45e3-a58a-8caea7e4ac17 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.715249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.720892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.721563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.721842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.722140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.723352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.725401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.726719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 140/288] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:04.732409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.771888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:04.794271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54718-38c9-4314-9167-d038086edf5a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.844148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.844774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.845050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.845321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.846005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:04.846861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.848647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.860937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05ba20-f4a2-4065-a553-4b68f8f51646 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:04.862491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 149/289] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:04.868297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:04.906139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:04.906933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:04.907241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:04.907520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/f7028ce3787f431790820d4d37487a2b/roles/06d85bf36b0b4646918c25bd5cbdd8c2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:04.909488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, user_id=f7028ce3787f431790820d4d37487a2b, role_id=06d85bf36b0b4646918c25bd5cbdd8c2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:04.910967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:04.927771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 141/290] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:04 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/users/f7028ce3787f431790820d4d37487a2b/roles/06d85bf36b0b4646918c25bd5cbdd8c2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:00:05.024495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:05.029270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554624f3-229b-40a2-b114-15be1a24aed9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:05.070976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:05.071646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:05.071923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:05.072194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] PATH_INFO: `/v3/users/e7b34e8e44e24f468c52c37f92814e62` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:05.074206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b34e8e44e24f468c52c37f92814e62)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:05.075842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:05.077866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 150/291] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:04 2022] GET /identity/v3/users/e7b34e8e44e24f468c52c37f92814e62 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:05.084311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:05.232596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:05.255306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3055-715f-43c8-8ec4-b538b9c429f2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:05.292807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:05.293353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:05.293630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:05.293902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:05.373063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:05.374625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:05.482985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:05.494394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 142/292] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:05.500078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:05.697868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88d28-aabe-49f5-8c6f-677857062e17 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:05.753732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:05.754749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:05.755171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:05.755594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:05.757434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:05.759788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8d38a-16a7-4547-ab6e-f7c10050e061 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:05.762263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 151/293] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:05 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:05.768538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:05.895252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ce2e5-fd8c-4d1b-bd59-95191879a0ad None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:05.939733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:05.940357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:05.940634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:05.940903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:05.941637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=e7b34e8e44e24f468c52c37f92814e62) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:05.941942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:05.943465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fe125-17b4-4f2f-84c7-3a5000957f24 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:05.953718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 143/294] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:05 2022] GET /identity/v3/role_assignments?user.id=e7b34e8e44e24f468c52c37f92814e62&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:06.630115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a74e8-65b7-4387-aacf-fa85f70f6921 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:06.630969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a74e8-65b7-4387-aacf-fa85f70f6921 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:06.631285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a74e8-65b7-4387-aacf-fa85f70f6921 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:06.632803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 152/295] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:06.638895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8888a-ca7c-4a5c-bf5a-e0666417c6ca None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:06.639800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8888a-ca7c-4a5c-bf5a-e0666417c6ca None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:06.640259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8888a-ca7c-4a5c-bf5a-e0666417c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:06.661045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e1a8888a-ca7c-4a5c-bf5a-e0666417c6ca None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:06.662573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e1a8888a-ca7c-4a5c-bf5a-e0666417c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:06.725518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:06.745201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 144/296] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:06.914075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48685-569a-4dee-afbd-55f0e4dd2809 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:06.914258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48685-569a-4dee-afbd-55f0e4dd2809 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:06.914537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48685-569a-4dee-afbd-55f0e4dd2809 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:06.916128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 153/297] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:06.921563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f756-ac9a-4e59-b5ad-286159b3f4cd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:06.922061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f756-ac9a-4e59-b5ad-286159b3f4cd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:06.922523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f756-ac9a-4e59-b5ad-286159b3f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:06.941089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a892f756-ac9a-4e59-b5ad-286159b3f4cd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:06.942584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a892f756-ac9a-4e59-b5ad-286159b3f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:07.012945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 145/298] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:07.030840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f48685-569a-4dee-afbd-55f0e4dd2809 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.068914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.137695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f48685-569a-4dee-afbd-55f0e4dd2809 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.175133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.175772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.176049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.176455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.183560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fca75-7e71-4ab2-ae06-b7642376218b None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.184124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fca75-7e71-4ab2-ae06-b7642376218b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.184606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fca75-7e71-4ab2-ae06-b7642376218b None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.186749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 146/299] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:07.191233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:07.193147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:07.194632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:07.196089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 154/300] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:07.200558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.201922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.202627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.203362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.225897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:07.227615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:07.319380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 147/301] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:07.319380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.325513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.332269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ae2f5-de8a-44bf-997e-a083444aa241 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.383840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.390302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.390924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.391221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.391500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.392174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:07.392478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:07.394429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46feb1b-9900-4ccd-b7a4-c501961f877e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:07.406969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 155/302] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:07.407214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a6d8-0526-44db-9db7-91c085a28730 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.407508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a6d8-0526-44db-9db7-91c085a28730 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.407777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a6d8-0526-44db-9db7-91c085a28730 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.412588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 156/303] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:07.413884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a6d8-0526-44db-9db7-91c085a28730 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.461258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef065-4426-41a1-9d9b-96fe713dcfec None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.520483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.521141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.521414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.521682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.522844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:07.524382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfad26f-dae4-4920-8753-420e8ee06484 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:07.526306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 148/304] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:07.532434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.532716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.532981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.544152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a6d8-0526-44db-9db7-91c085a28730 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.550943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:07.552171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:07.586009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.586646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.586920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.587207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] PATH_INFO: `/v3/users/b75ede8ed285407eac492c0223f7a863` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.588358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] RBAC: Authorizing `identity:get_user(user_id=b75ede8ed285407eac492c0223f7a863)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:07.590315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:07.591716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 157/305] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/users/b75ede8ed285407eac492c0223f7a863 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:07.597297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.629541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 149/306] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:07.630508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.632063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.681751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.712884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c1ed-4ee7-4d3f-b433-852c9037634b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.740011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387aaa5-e615-4775-b859-df0830e3f8f5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.748114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.748742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.749014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.749280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] PATH_INFO: `/v3/groups` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.749913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:07.751409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:07.779208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 158/307] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 24 13:00:07 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:07.779208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.784127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.784898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.785176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.785448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] PATH_INFO: `/v3/system/users/b75ede8ed285407eac492c0223f7a863/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.787125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b75ede8ed285407eac492c0223f7a863, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:07.788718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:07.800910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 150/308] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 24 13:00:07 2022] PUT /identity/v3/system/users/b75ede8ed285407eac492c0223f7a863/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:07.895209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:07.896161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:07.919876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abb8e-d1c6-4171-abf6-bd7763ed9d2e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:07.977998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:07.977998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:07.978263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:07.978476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:07.996155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:08.001652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:08.002570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:08.003379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 159/309] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:08.011380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.028286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094872-3b8a-4504-b12c-bd7e0d5c533e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.040758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.075459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.076441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.076721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.076992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.091917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:08.097359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:08.098302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:08.099074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 151/310] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:08.106553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.144102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b26c19-33ac-4dc8-86ca-933251e9a0cf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.190321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.191388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.191884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.192734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.193939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:08.194592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.196500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.208892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 160/311] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:08.214635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.217359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b808d0-619d-4da6-a649-a5319188aa2e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.230214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.256404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.257029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.257326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.257576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.258260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:08.258568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.260097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.274242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 152/312] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:08.279354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.324216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.364018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c14d98-5f80-462e-8ecc-497440b61f99 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.402219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.403719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.404483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.404952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] PATH_INFO: `/v3/users/5cd2138034e641758a98934033fa59e9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.407791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117393a-d4a4-4501-b3eb-e80c46b86c46 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.420378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] RBAC: Authorizing `identity:get_user(user_id=5cd2138034e641758a98934033fa59e9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.422299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.424338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 161/313] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/users/5cd2138034e641758a98934033fa59e9 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:08.430338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.443825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.444429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.444708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.444980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] PATH_INFO: `/v3/users/f7028ce3787f431790820d4d37487a2b` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.446145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] RBAC: Authorizing `identity:get_user(user_id=f7028ce3787f431790820d4d37487a2b)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.447741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.449563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 153/314] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/users/f7028ce3787f431790820d4d37487a2b => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:08.455320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.504733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.544152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ee8fd-2623-4e53-b3d5-46c29e077984 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.567201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.572027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baf8bd-35ce-4937-9adb-d7814e242841 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.584050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.585107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.585637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.586098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.587252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, user.id=5cd2138034e641758a98934033fa59e9, scope.system=all) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:08.587753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.589499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.595829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 162/315] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/role_assignments?user.id=5cd2138034e641758a98934033fa59e9&scope.system=all&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:08.618082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.621980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.621980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.621980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.704810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.706351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.812499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.823440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 154/316] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:08.825228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:08.945628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e26a-2dee-470f-a1ad-06bd818de78a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:08.978404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:08.988821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:08.989474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:08.989752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:08.990021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:08.991154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:08.992660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbe8d4-9976-4fcc-b9c0-ba92acb1fd80 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:08.995007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 163/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:08 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:09.001468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:09.112901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a6d4f-2b1c-4d52-a3db-4c1d19882d41 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:09.153013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:09.154016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:09.154296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:09.154570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:09.155325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, scope.project.id=a4da5eca2f5a4030a84937de598a8f38, user.id=f7028ce3787f431790820d4d37487a2b) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:09.155636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:09.157192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a362ac8-7cc2-40c6-96db-6d35768de33d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:09.163791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 155/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:09 2022] GET /identity/v3/role_assignments?user.id=f7028ce3787f431790820d4d37487a2b&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:09.815070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a873-fbc5-4a11-8b56-edfae219be06 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:09.815563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a873-fbc5-4a11-8b56-edfae219be06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:09.815648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8a873-fbc5-4a11-8b56-edfae219be06 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:09.817150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 164/319] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:09.822433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:09.822897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:09.822986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:09.841698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:09.842923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:09.880647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff706dd-3664-4626-980e-c56fac83dd96 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:09.881152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff706dd-3664-4626-980e-c56fac83dd96 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:09.881152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff706dd-3664-4626-980e-c56fac83dd96 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:09.882572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 165/320] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:09.888031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:09.888375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:09.888642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:09.903893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:09.908461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:09.909618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:09.916024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 156/321] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:09.987208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 166/322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:10.178369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.246142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.300903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfad982-d446-460e-a71c-1a8ec7eddccb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.339433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.340084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.340345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.340615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.351977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:10.356787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:10.357902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:10.358772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 157/323] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:10.362795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483f86a-64fa-4ca0-9736-28b89b47b97f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.363941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.395219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:10.404167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.404923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.405206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.405471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.406610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:10.408096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:10.409849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 167/324] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:10.415393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.425716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:10.479230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e6387-cc7a-4d30-8a02-26f571f666db None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.515629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.516245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.516541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.516871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.517440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:10.517736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:10.519130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:10.521973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb32438-f632-4a2d-b84b-ccbfc4d2191e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.527950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 158/325] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:10.533635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.559366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.560374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.560895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.561167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] PATH_INFO: `/v3/groups` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.561877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:10.563454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a93f3f-8590-4e67-a7f2-2279d333c960 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:10.587761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 168/326] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 24 13:00:10 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:00:10.587761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d123-4f33-4691-ba73-8b56540064d9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.587761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d123-4f33-4691-ba73-8b56540064d9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.587761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d123-4f33-4691-ba73-8b56540064d9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.587761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 169/327] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:10.589484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.589771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.590044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.610036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:10.611300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:10.657401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1826735-7049-4915-b028-d681d53fdae3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.672399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:10.674884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:10.695485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 170/328] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:10.705744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.706683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.707117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.707570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] PATH_INFO: `/v3/users/b75ede8ed285407eac492c0223f7a863` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.709035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] RBAC: Authorizing `identity:get_user(user_id=b75ede8ed285407eac492c0223f7a863)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:10.710703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:10.712646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 159/329] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/users/b75ede8ed285407eac492c0223f7a863 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:10.719061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:10.837805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd59a-094d-4802-8cdb-f5632a6d48da None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:10.875984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:10.876601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:10.876879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:10.877137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:10.877876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] RBAC: Adding query filter params (role.id=10d6f35654da41fc8e0858935bc39a37, user.id=b75ede8ed285407eac492c0223f7a863, scope.system=all) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:10.878180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:10.879657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:10.892709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 171/330] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/role_assignments?user.id=b75ede8ed285407eac492c0223f7a863&scope.system=all&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:11.000383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:11.120139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a02b-5847-4649-bb84-c9e486b8790c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:11.164751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:11.166760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:11.166760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:11.166760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:11.181025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:11.186614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:11.188941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:11.190895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 160/331] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:11.202213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:11.272784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:11.341267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0f1d-9a3b-4987-8ad5-c9b960a4bb1a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:11.401512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:11.402305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:11.402712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:11.403130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:11.404703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:11.405268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:11.407553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:11.425201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 172/332] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:11.430493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:11.497115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:11.584077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4a32-5184-4921-88b9-e7cc90fd99ee None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:11.634287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:11.634957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:11.635273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:11.635544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] PATH_INFO: `/v3/users/5cd2138034e641758a98934033fa59e9` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:11.636773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] RBAC: Authorizing `identity:get_user(user_id=5cd2138034e641758a98934033fa59e9)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:11.638332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3c646-74fa-4fa2-8c07-f16562b8dafb None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:11.640305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 161/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:11 2022] GET /identity/v3/users/5cd2138034e641758a98934033fa59e9 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:11.645758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:11.782503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567277a-5c0c-438b-a6ea-7a7ebd1ceffa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:11.791986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:11.826469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:11.827129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:11.827421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:11.827695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] PATH_INFO: `/v3/system/users/5cd2138034e641758a98934033fa59e9/roles/06d85bf36b0b4646918c25bd5cbdd8c2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:11.829122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5cd2138034e641758a98934033fa59e9, role_id=06d85bf36b0b4646918c25bd5cbdd8c2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:11.830513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313b1c9-f0e6-48b1-bc6f-0ec8a0e71d69 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:11.845155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 173/334] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 24 13:00:11 2022] PUT /identity/v3/system/users/5cd2138034e641758a98934033fa59e9/roles/06d85bf36b0b4646918c25bd5cbdd8c2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:12.834466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11605-7e0e-4c15-9121-13d881703288 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:12.834987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11605-7e0e-4c15-9121-13d881703288 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:12.834987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11605-7e0e-4c15-9121-13d881703288 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:12.836583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 162/335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:12.842320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171ae9-6cd9-4814-8153-049aca84cc0d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:12.842818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171ae9-6cd9-4814-8153-049aca84cc0d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:12.842893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171ae9-6cd9-4814-8153-049aca84cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:12.864172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-71171ae9-6cd9-4814-8153-049aca84cc0d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:12.865388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-71171ae9-6cd9-4814-8153-049aca84cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:12.942626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 174/336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:13.433893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82f5e-ed73-411b-8ccd-2f3c5a4b5c11 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.433893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82f5e-ed73-411b-8ccd-2f3c5a4b5c11 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.433893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82f5e-ed73-411b-8ccd-2f3c5a4b5c11 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.434666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 163/337] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:13.445532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fb3f-0720-4720-b34a-8e1e98fba3ef None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.446154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fb3f-0720-4720-b34a-8e1e98fba3ef None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.446617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5fb3f-0720-4720-b34a-8e1e98fba3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.450234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ff9-a00c-4eb1-a181-881d81d483b0 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.451446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ff9-a00c-4eb1-a181-881d81d483b0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.452468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8ff9-a00c-4eb1-a181-881d81d483b0 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.462439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 175/338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:13.463641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8ff9-a00c-4eb1-a181-881d81d483b0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:13.485083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f5c5fb3f-0720-4720-b34a-8e1e98fba3ef None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:13.486656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f5c5fb3f-0720-4720-b34a-8e1e98fba3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:13.617748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 164/339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:13.619444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.619932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.620391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.650476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:13.652248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:13.679553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:13.688377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8ff9-a00c-4eb1-a181-881d81d483b0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:13.697265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:13.736166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 165/340] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:13.754305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:13.755213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.755661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.756068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.769712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:13.774762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:13.775828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:13.776775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:13.779510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 176/341] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:13.785438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:13.921306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49ec1e-3e84-46e2-bd08-ace532b86c94 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:13.959992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:13.960963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:13.961448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:13.961904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:13.962780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:13.963296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:13.965000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:13.977436 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 166/342] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:13.983631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.042993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.083566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:14.155030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8ee6-ae9a-4781-a280-6665e0e30fa9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.222710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa64c-874c-4c91-971e-357996580740 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.234553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:14.235202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.235605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.235968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.291826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:14.292483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.294090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.294480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.295890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:14.319359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:14.327770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:14.328879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:14.329684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 167/343] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:14.331604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.378893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:14.380416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:14.543398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:14.558240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03995-e09a-4187-bd5b-a423a4dc87f9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.590166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 177/344] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:14.591450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.610175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:14.611283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.611771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.612245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.642896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:14.648777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:14.649844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:14.651644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 168/345] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:14.657333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.700037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:14.762597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b087-62d6-4c23-9a84-9a142fde4d19 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.790326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2ec4-b3a4-40c7-be7f-f6c3211dcc19 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.806220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:14.807336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.807756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.808161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.808974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:14.809451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:14.811316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:14.820983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 178/346] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:14.822082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.828857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:14.829521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.829801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.830075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.831230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:14.832901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b54e-39bd-4059-ad93-54c4ce8fe998 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:14.834781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 169/347] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:14.836299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a34d-2291-49ae-8e1a-630279cd0923 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:14.836580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a34d-2291-49ae-8e1a-630279cd0923 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:14.836898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a34d-2291-49ae-8e1a-630279cd0923 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:14.838109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 170/348] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:14.838808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717a34d-2291-49ae-8e1a-630279cd0923 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:14.863760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:14.953160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e7efc-f9fe-46a4-91e1-f1664c6ffe3c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.974868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717a34d-2291-49ae-8e1a-630279cd0923 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:14.982844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.001755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.003780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.004385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.004866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.005979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:15.006815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.008564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.020772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 179/349] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:15.022370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.030092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.030995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.031512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.031929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.124447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.126066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.149655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.164197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27558794-057d-4ab7-915d-c7e1a6f8d964 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:15.207228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.208334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.208806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.209266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.216901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.218639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2efccf-8037-4589-9152-610f9dac7099 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.220869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 180/350] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:15.222247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8af8a-9da6-415e-af99-dba3f6466989 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.222721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8af8a-9da6-415e-af99-dba3f6466989 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.224213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8af8a-9da6-415e-af99-dba3f6466989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.238848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 171/351] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:15.239790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.245290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c6a8af8a-9da6-415e-af99-dba3f6466989 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:15.245290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c6a8af8a-9da6-415e-af99-dba3f6466989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:15.294159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.321852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 181/352] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:15.323398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c164c-c988-4cc6-b548-e07a8b02054d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.323665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c164c-c988-4cc6-b548-e07a8b02054d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.325110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c164c-c988-4cc6-b548-e07a8b02054d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.325214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 182/353] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:15.325893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c164c-c988-4cc6-b548-e07a8b02054d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.371826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301f047-1c57-496a-88e8-85b7d02233f9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:15.411240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.421554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.422171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.422447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.422718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.461556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c164c-c988-4cc6-b548-e07a8b02054d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:15.501481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.503015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427d23-27f8-4d3b-86bc-707903dd975b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.504350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.505230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.505230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.505422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.506346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=1874aa7556d94cd1a5e671aefe930726) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:15.506653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.508691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefeb7-1b51-4562-bc91-f2ffc9eb73da None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.519938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 183/354] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:15.521341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8ac2-87b2-45fd-bf86-46b2a0b9d324 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.521630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8ac2-87b2-45fd-bf86-46b2a0b9d324 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.522052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d8ac2-87b2-45fd-bf86-46b2a0b9d324 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.523865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 184/355] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:15.525010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d8ac2-87b2-45fd-bf86-46b2a0b9d324 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.603643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.663324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 172/356] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:15.663540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.663636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.663902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.686500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:15.687993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:15.692441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d8ac2-87b2-45fd-bf86-46b2a0b9d324 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:15.711369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.739579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.740549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.740831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.741104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.744193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:15.744636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f411116-470c-4b58-bf34-ad979009e9e2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:15.746461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 185/357] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:15.748562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.748855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.749112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.771001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:15.772278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:15.781539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 173/358] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:15.782410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.856201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 186/359] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:15.857537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.890083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2840cd-ab6d-41bf-bef8-4af5c31cfbb5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:15.905162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:15.930989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:15.931874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:15.931874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:15.932150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:15.942998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:15.949152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:15.950228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:15.951113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 174/360] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:15.951846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:15.976290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.038961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89564f-2248-47b8-a4e3-d176b9adb6a2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.064581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534621-4ac9-46b1-997a-0b52c0135e0d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.104009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.104799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.105080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.105352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.106665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.108651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.110770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 175/361] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:16.111692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.121403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.122508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.122992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.123506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.127943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.129724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.131853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 187/362] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:15 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:16.132907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.199538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.222977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebc2-7a3a-4a89-88e4-4d96bbbb9e68 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.267837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.268489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.269129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.269404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.270096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:16.270398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.271887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.283853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 176/363] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:16.284897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.341289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d148edb-10fa-4543-95aa-0a0611c6bb88 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.355248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.392118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.393551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.394092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.394597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.395897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=a4da5eca2f5a4030a84937de598a8f38) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:16.396282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.398010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.405408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 188/364] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:16.406366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.412183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054a604-b2fa-4695-b658-472badd7845a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.454689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.455304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.455635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.455916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.457115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.458599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.461206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 177/365] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:16.464640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.476428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.557761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc48954-4401-4331-8ad6-b0d1b247c233 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.596821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b753-255d-4ce7-9a4e-f2dca7a96442 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.610551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.611648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.611923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.612284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.633139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:16.649785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:16.651767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 189/366] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:16.653661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.658005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.658642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.660450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.660450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.698261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.757842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:16.759556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:16.773710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:16.795298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968efdb-6ec8-4226-8601-8ea9a4149f4e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:16.878190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:16.879171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:16.879748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:16.880185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:16.898197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:16.904879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:16.905815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:16.906583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 190/367] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:16.907250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:16.943607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 178/368] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:16.945135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.021456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.033585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec30e-a476-4c90-8695-ce9e0921a940 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.083528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52fb46-fe69-43f6-9b5d-c1e67474fae3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.095792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.105947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.107632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.108165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.108857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.110291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=1874aa7556d94cd1a5e671aefe930726) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:17.110812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.112581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.121581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 191/369] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=56a6a91609874159a6cf397498dea0cd => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.122758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.150206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.154950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.155618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.156116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.157021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:17.157535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.159205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.173210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 179/370] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.175330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.301387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034cbae-03d3-46a4-8b92-cab9649bcb4d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.349963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.350593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.350884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.351141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.351846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:17.352141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.353613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.354824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ef943-e5d6-4ded-8393-0ce56efa5e07 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.364812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 192/371] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.365787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.388471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.415312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.416373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.416988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.417458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.418909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.420777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.422747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 180/372] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.424027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.469259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.525334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96d078-154f-44ce-9a97-bc8b6bbdcef1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.536856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2399-6f6e-4176-85f0-0013d551bece None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.573118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.574117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.574583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.575051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] PATH_INFO: `/v3/users/5cd2138034e641758a98934033fa59e9` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.576444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=5cd2138034e641758a98934033fa59e9)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.578263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.580174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 181/373] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/users/5cd2138034e641758a98934033fa59e9 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.581133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.600871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.601501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.601772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.602034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.689785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd850ca4-f083-46f8-a717-c4729c97b3d6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.697235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.726887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.727563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.727839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.728119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.729334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.731047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.733126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 182/374] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.733906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.760385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.761745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86e968-936d-4c9d-baef-823e22c51f09 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.803614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.842359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5fa8-f8e2-4207-9c87-3bc33f69987e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:17.881105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:17.882291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.882779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.883400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.884689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] RBAC: Adding query filter params (role.id=06d85bf36b0b4646918c25bd5cbdd8c2, user.id=5cd2138034e641758a98934033fa59e9, scope.system=all) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:17.885172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:17.888304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:17.902817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 183/375] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/role_assignments?user.id=5cd2138034e641758a98934033fa59e9&scope.system=all&role.id=06d85bf36b0b4646918c25bd5cbdd8c2 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:17.904134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:17.946831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 193/376] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:17.948685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994e61-e384-4718-814b-92854ff1c964 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:17.949189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994e61-e384-4718-814b-92854ff1c964 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:17.949911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994e61-e384-4718-814b-92854ff1c964 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:17.952747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 194/377] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:17.953272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:17.958874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994e61-e384-4718-814b-92854ff1c964 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:18.066167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9e29-4ca3-4c33-a2c8-4f22c3147108 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:18.117053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994e61-e384-4718-814b-92854ff1c964 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:18.123871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:18.125205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.125701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.126181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.127115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=a4da5eca2f5a4030a84937de598a8f38) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:18.127644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:18.129475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a853-b718-4a62-9d6d-ccc1a5155446 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:18.136001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 184/378] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=56a6a91609874159a6cf397498dea0cd => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:18.137656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.138224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.138691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.150903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:18.164488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:18.165155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.165436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.165705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] PATH_INFO: `/v3/projects/a1e6eefe19074b16ac82b646f2c6375a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.167121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:18.168385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:18.171671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] RBAC: Authorizing `identity:get_project(project_id=a1e6eefe19074b16ac82b646f2c6375a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:18.173181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:18.175422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 195/379] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:17 2022] GET /identity/v3/projects/a1e6eefe19074b16ac82b646f2c6375a => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:18.189443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:18.285502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 185/380] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:18.379227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d12bb0-0d3d-4647-bcf1-e53229a08c9f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:18.434923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:18.435610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.435973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.436240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] PATH_INFO: `/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.443961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d3fb38f98745e392647f1ecef5d0a7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:18.445472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:18.447622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 196/381] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:18 2022] GET /identity/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:18.453652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:18.503730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:18.611746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b23b-7ca3-451f-b926-87cecdc0661b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:18.620164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:18.680861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:18.681420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.681700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.681980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.682736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] RBAC: Adding query filter params (group.id=c8d3fb38f98745e392647f1ecef5d0a7, role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=a1e6eefe19074b16ac82b646f2c6375a) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:18.683046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:18.685112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:18.694518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:18.697260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 186/382] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:18 2022] GET /identity/v3/role_assignments?group.id=c8d3fb38f98745e392647f1ecef5d0a7&scope.project.id=a1e6eefe19074b16ac82b646f2c6375a&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:18.783896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0557-4b93-4931-b013-f8c7eaef3c62 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:18.836976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:18.837997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:18.838507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:18.838969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:18.855509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8fc52fde-38ce-4268-887b-cf1c34d64e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:18.860799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:18.861671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:18.862466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:18.864898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 197/383] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:18.873706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.027525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:19.044534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d695bb6-43ee-4946-a2df-31dcac09ede2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:19.089355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:19.089987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.090274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.090551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.091334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:19.091644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:19.093052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:19.102114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b332-ff51-4666-b483-76b127c8285b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.102404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b332-ff51-4666-b483-76b127c8285b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.102656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b332-ff51-4666-b483-76b127c8285b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.104341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 198/384] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:19.108638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 187/385] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:19.110732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305932-def5-48c7-aae6-93108092d5cf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.111021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305932-def5-48c7-aae6-93108092d5cf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.111331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41305932-def5-48c7-aae6-93108092d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.114123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.134556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-41305932-def5-48c7-aae6-93108092d5cf None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:19.136549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-41305932-def5-48c7-aae6-93108092d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:19.215506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 199/386] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:19.317280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3ca3-7f71-4a80-8b06-98227f002a42 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:19.354960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:19.355636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.355916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.356190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.357376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:19.358904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:19.360907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 188/387] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:19 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:19.366598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305932-def5-48c7-aae6-93108092d5cf None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.429716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:19.527773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41305932-def5-48c7-aae6-93108092d5cf None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:19.577908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:19.578475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.578752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.579024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.580199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:19.581660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:19.583774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 200/388] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:19 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:19.589497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.595814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.643986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:19.782969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0faa2-93db-402a-84c5-bf77e16841c5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:19.794711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134725b-aae2-4d32-b4c7-3afecf6ec68e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:19.795554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:19.825543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:19.826192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.826467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.826736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.839268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:19.845496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:19.846424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:19.847670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 201/389] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:19.860521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:19.870537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:19.874849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.875129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.875432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/groups/7af2c123902041f7abeafe26e948be94/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.877493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, group_id=7af2c123902041f7abeafe26e948be94, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:19.878972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaf6e0-3159-42f6-b057-9f808c336c29 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:19.904841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 189/390] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 13:00:19 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/groups/7af2c123902041f7abeafe26e948be94/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:19.993528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ed5f-081c-45cc-b05e-4b3083e91c64 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:19.993856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ed5f-081c-45cc-b05e-4b3083e91c64 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:19.994087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ed5f-081c-45cc-b05e-4b3083e91c64 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:19.996135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 190/391] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:20.005115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.005458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.005723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.048294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:20.050437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:20.069799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14abf-1e55-448e-a5fa-53d3d65ccd29 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.137298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.138809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.139309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.139768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.140649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:20.141136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:20.142737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:20.150381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 191/392] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:20.155352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 202/393] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:20.160726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:20.175616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:20.269303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a3724-aa7f-49f2-9f9c-5199e513c9ff None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.307364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.308043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.308370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.308675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.309999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:20.311564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:20.313618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 192/394] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:20 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:20.319332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:20.353088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:20.433830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd6d-5053-4c20-abee-47afa74b69f5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.472078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:20.486349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.486999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.487311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.487584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.492189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:20.493687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:20.495481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 203/395] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:20 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:20.508589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:20.574651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:20.603986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dccd7f-7fa2-4416-9c9d-fc57446a0e26 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.641443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:20.646425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3494747-f6ff-4648-a2d7-4e7fbc79b03d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.649067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.650666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.650962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.651507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.665084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-2f5e7f54-3d50-4f9f-9429-a8bbb1c71ff8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:20.670946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:20.672052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:20.672949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 193/396] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:20.673598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7706a-ec14-4b05-bc50-e99176fc9df4 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.673884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7706a-ec14-4b05-bc50-e99176fc9df4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.674159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7706a-ec14-4b05-bc50-e99176fc9df4 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.679229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 194/397] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:20.679229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7706a-ec14-4b05-bc50-e99176fc9df4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:20.696100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.696763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.696994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.697338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/groups/7af2c123902041f7abeafe26e948be94/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.699361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, group_id=7af2c123902041f7abeafe26e948be94, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:20.701061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd63fb4-bd92-468d-b4e7-c23be787f3f5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:20.718958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 204/398] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 13:00:20 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/groups/7af2c123902041f7abeafe26e948be94/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:20.724716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.725001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.725403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.781107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:20.784277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:20.938067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7706a-ec14-4b05-bc50-e99176fc9df4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:20.938274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 205/399] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:20.982398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:20.982904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:20.983198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:20.983480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:20.984158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:20.984466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:20.985869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:20.993850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:21.001184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 195/400] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:21.006625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.116693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:21.129571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30177-2803-4669-8c1f-2fde3518ed85 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.166164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:21.166853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.167079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.167376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.168503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:21.170041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:21.172051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 206/401] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:21.180321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.294337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.359319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3658-831c-4bdc-8d56-234441f6dfa4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.411418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:21.412312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.412767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.413178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.415084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:21.416728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688776ee-69c9-44a6-b196-74393a8239bb None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:21.418560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 196/402] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:21.420065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399bf9-7e33-4863-ab20-fe8f7f906b00 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.420547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399bf9-7e33-4863-ab20-fe8f7f906b00 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.421032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e399bf9-7e33-4863-ab20-fe8f7f906b00 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.422512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 197/403] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:21.427837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399bf9-7e33-4863-ab20-fe8f7f906b00 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.460326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1082-40d5-4b1e-a383-12292c47b2c5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.499623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:21.501151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.501793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.502286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.516525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:21.521781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-051cafe9-631c-471a-ab29-e360636fe26a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:21.525018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:21.526713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:21.527761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:21.535791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 207/404] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:21.537248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.538052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.538481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.562818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:21.564519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:21.566253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e399bf9-7e33-4863-ab20-fe8f7f906b00 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.578765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:21.620975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:21.622113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.622614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.623157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726/groups/7af2c123902041f7abeafe26e948be94/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.625755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] RBAC: Authorizing `identity:create_grant(project_id=1874aa7556d94cd1a5e671aefe930726, group_id=7af2c123902041f7abeafe26e948be94, role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:21.627584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:21.646812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 198/405] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 13:00:21 2022] PUT /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726/groups/7af2c123902041f7abeafe26e948be94/roles/56a6a91609874159a6cf397498dea0cd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:00:21.648127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.655575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 208/406] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:21.763143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e919-a5ec-4585-84bf-b7a05a4d02ba None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.793988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:21.803590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:21.804536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:21.805018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:21.805489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:21.806439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:21.806921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:21.808580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:21.819256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 199/407] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:21.828878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:21.962478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb7c4f-1db1-4535-b2d4-d05d3e9d3503 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:21.981225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.004696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.005364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.005633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.005922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.007048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.008566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.010163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 209/408] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:22.015763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.035931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.105044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f6c95-589b-4c24-bc13-fb8ebce829cf None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.127609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5f1e8-96f8-462e-896b-b81c0a2b996d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.152531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.153199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.153908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.154186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.172946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:22.177260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a931-e526-49af-8d95-f99580583649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.177915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a931-e526-49af-8d95-f99580583649 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.178197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a931-e526-49af-8d95-f99580583649 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.178471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a931-e526-49af-8d95-f99580583649 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:22.181613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:22.182473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:22.183277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:22.183865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057a931-e526-49af-8d95-f99580583649 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.184414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057a931-e526-49af-8d95-f99580583649 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.186571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 210/409] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:22 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:22.192067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 200/410] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:22.198039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a931-e526-49af-8d95-f99580583649 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.209403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.311426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.359658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.371864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a931-e526-49af-8d95-f99580583649 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.376734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5916fbd-b6f5-4481-9566-78e4155d386f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.413041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.413665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.413941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.414209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.414894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:22.415228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.416612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0344-9333-4fcf-9b05-fa8ee1cbc86a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.421239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.421923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.422300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.422578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38/groups/7af2c123902041f7abeafe26e948be94/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.424804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4da5eca2f5a4030a84937de598a8f38, group_id=7af2c123902041f7abeafe26e948be94, role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.425847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 211/411] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:22.426273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25282f69-71d3-496d-af89-51d4dd5f2f91 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.427098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6957-8af9-4ae3-b3ad-188968d5bb56 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.427422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6957-8af9-4ae3-b3ad-188968d5bb56 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.427696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d6957-8af9-4ae3-b3ad-188968d5bb56 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.434206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 212/412] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:22.435786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d6957-8af9-4ae3-b3ad-188968d5bb56 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.452580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 201/413] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 13:00:22 2022] PUT /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38/groups/7af2c123902041f7abeafe26e948be94/roles/56a6a91609874159a6cf397498dea0cd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:22.456470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da096-9475-4858-a860-fab45a067992 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.456787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da096-9475-4858-a860-fab45a067992 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.457051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da096-9475-4858-a860-fab45a067992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.492596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-810da096-9475-4858-a860-fab45a067992 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:22.493850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-810da096-9475-4858-a860-fab45a067992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:22.630121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d6957-8af9-4ae3-b3ad-188968d5bb56 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.661485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 202/414] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:22.681541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.682464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.682886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.683413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] PATH_INFO: `/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.685177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d3fb38f98745e392647f1ecef5d0a7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.687527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.690032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 213/415] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:22 2022] GET /identity/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:22.696574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da096-9475-4858-a860-fab45a067992 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.749221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.810372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da096-9475-4858-a860-fab45a067992 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:22.846016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:22.846668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:22.846942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:22.847241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] PATH_INFO: `/v3/projects/a1e6eefe19074b16ac82b646f2c6375a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:22.848398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e6eefe19074b16ac82b646f2c6375a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:22.849924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:22.852024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 203/416] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:22 2022] GET /identity/v3/projects/a1e6eefe19074b16ac82b646f2c6375a => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:22.860269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:22.887763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:22.977101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caace-647e-460f-a76a-b220ef69ab13 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:23.018479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:23.019158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.019501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.019780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] PATH_INFO: `/v3/projects/a1e6eefe19074b16ac82b646f2c6375a/groups/c8d3fb38f98745e392647f1ecef5d0a7/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.022161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e6eefe19074b16ac82b646f2c6375a, group_id=c8d3fb38f98745e392647f1ecef5d0a7, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:23.023785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12f0de-f40a-4311-924c-9aa7eef9b531 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:23.041806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 214/417] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 13:00:22 2022] PUT /identity/v3/projects/a1e6eefe19074b16ac82b646f2c6375a/groups/c8d3fb38f98745e392647f1ecef5d0a7/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:23.066471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:23.100240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5ddb-bdde-4dcc-839b-b12e8bc27805 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.100577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5ddb-bdde-4dcc-839b-b12e8bc27805 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.100771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5ddb-bdde-4dcc-839b-b12e8bc27805 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.102627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 215/418] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:23.108623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.108932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.109161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.129202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:23.130599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:23.189583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b17ee-cc35-4807-820b-98e1917ede95 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:23.201611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:23.232976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:23.233916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.234260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.234596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.247423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:23.253348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:23.254445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:23.255444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:23.257555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 204/419] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:23.264096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:23.291146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 216/420] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:23.433236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd23db-c8db-4c1d-99e0-b4467e5cc946 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:23.478692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:23.479245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.480140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.480415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.481161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:23.481463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:23.483893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:23.497952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 205/421] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:23.499460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:23.502535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:23.668212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e17c2c-02ad-41c2-aef7-9c4ff041c0ac None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:23.673816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:23.722049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:23.724663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.725565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.726564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.743445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:23.859529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:23.861132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:23.872845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c8a8c-60f4-4147-ba75-91dff0fae9f2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:23.887577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:23.939064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:23.940005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:23.941404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:23.941974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:23.964769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:23.974777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:23.975961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 13:00:23.976925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:23.980450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 206/422] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:24.000799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.018163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 217/423] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:24.024079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.155778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.177913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434421ac-c202-4b2b-a43c-5b525d2d1786 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.194131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d6c0-a320-43c0-bfbe-fa1821ae594b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.195753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.234217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.234868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.235147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.235447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.236930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.238523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.240595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 218/424] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:24.245932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.263629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.264152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.264422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.264695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.265376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] RBAC: Adding query filter params (name=member) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:24.265681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.267110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.284800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 207/425] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:24.293368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.419679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b8d43-c023-4a54-a7de-c864a6c0b5da None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.430099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03e03-d3ae-4aa7-9f33-1148dae2d3e4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.458225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.458959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.459271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.459547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.472953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.473602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.473881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.474153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.475297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.476978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ac405-237d-4faa-b480-7d0b996ea5ca None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.483568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 219/426] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:24.484861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd57b0-72b0-4185-b637-c13c33267c7b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.485144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd57b0-72b0-4185-b637-c13c33267c7b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.485418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd57b0-72b0-4185-b637-c13c33267c7b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.486919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 220/427] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:24.487665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.492010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd57b0-72b0-4185-b637-c13c33267c7b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.534106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.535523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.537133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7608e-3433-4bea-82f8-81adbf6b8597 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.596844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd57b0-72b0-4185-b637-c13c33267c7b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.637413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.638624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.639066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.639500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.640374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=1874aa7556d94cd1a5e671aefe930726) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:24.641279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.643138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.659214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 208/428] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:24.659214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756fef-e37c-4a7a-9313-99d2df65db40 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.659214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756fef-e37c-4a7a-9313-99d2df65db40 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.659214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756fef-e37c-4a7a-9313-99d2df65db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.660013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 221/429] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:24.661137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.681622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ce756fef-e37c-4a7a-9313-99d2df65db40 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:24.681622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ce756fef-e37c-4a7a-9313-99d2df65db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:24.799548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def7f68-c40d-4a29-a1ea-fba56b194bb1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.801834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.810217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:24.841948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:24.842906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.843396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.843850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.846100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:24.847952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:24.849825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 222/430] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:24.855464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:24.870381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 209/431] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:24.952775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec7b61-e5ed-4cfb-8ab2-66f99fd12c26 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.953054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec7b61-e5ed-4cfb-8ab2-66f99fd12c26 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.953325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec7b61-e5ed-4cfb-8ab2-66f99fd12c26 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.954671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 210/432] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:24.960263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:24.960580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:24.960808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:24.985653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162bf7-1cb3-4b7c-9679-6f38609fbf0f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:24.989733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:24.990968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:25.024566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.025460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.025878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.026286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.027685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:25.029738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:25.031805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 223/433] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:24 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:25.037474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.083652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.088169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 211/434] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:25.156760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2948-58e7-40d4-8945-8a7a503fd5fe None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.186333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.198160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.198867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.199261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.199610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.200500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=10d6f35654da41fc8e0858935bc39a37, scope.project.id=a4da5eca2f5a4030a84937de598a8f38) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:25.200810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:25.202327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:25.210094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 224/435] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=10d6f35654da41fc8e0858935bc39a37 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:25.311799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fd00c-e778-474c-82da-802a3d312ce4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.327554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.351905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.352479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.352812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.353089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.367082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:25.373369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:25.374328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:25.375102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 212/436] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:25.384357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.411426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.541980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd277542-ed52-47d9-9391-a831cde142e7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.549321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.575921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07debd-4f0f-4fae-82ff-9323924fd5b5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.608635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.609195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.609533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.609816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.610504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:25.610849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:25.612291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:25.622355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 225/437] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:25.627826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.638636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.639349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.639631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.639904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.659942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:25.667209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:25.668133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:25.669154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 213/438] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:25.674401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.725621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.769761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0208a7-eb85-4501-8d6c-53433bc78fbe None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.805114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a862-67d9-4225-bed6-6907ab179c67 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:25.812428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.813644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.814268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.814942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.858513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:25.859542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.859926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.860376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.861354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:25.861810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:25.863837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05219f41-2763-4aea-839a-e41a28bc6b3a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:25.865557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.876148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 214/439] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:25.877887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbf4c-702f-468d-8e6b-5c1ed583af89 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:25.878307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbf4c-702f-468d-8e6b-5c1ed583af89 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:25.878687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbf4c-702f-468d-8e6b-5c1ed583af89 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:25.881357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 215/440] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:25.882364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddbf4c-702f-468d-8e6b-5c1ed583af89 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:25.914770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:25.916261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a5490-258a-4a2c-ad7e-5c144d88568d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:25.976819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:25.984905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddbf4c-702f-468d-8e6b-5c1ed583af89 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.016793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 226/441] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:26.018043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.018323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.018589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.022349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.023133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.023379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.023648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.040684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:26.042009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:26.098184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.099813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.107116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.116448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 227/442] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:26.117233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.224946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.231014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9e3a-c4da-4811-863d-76db124121a3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.235237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 216/443] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:26.241042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.272378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.273424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.273707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.274265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] PATH_INFO: `/v3/projects/1874aa7556d94cd1a5e671aefe930726` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.275716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] RBAC: Authorizing `identity:get_project(project_id=1874aa7556d94cd1a5e671aefe930726)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.277872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.280383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 228/444] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/projects/1874aa7556d94cd1a5e671aefe930726 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:26.285699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.346910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.355467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ebc9-1fba-407e-82dd-e4f8053e723a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.388503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a7da-c3cd-4bb8-8215-29539a603d0d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.391450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.392093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.392371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.392639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] PATH_INFO: `/v3/projects/a4da5eca2f5a4030a84937de598a8f38` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.393762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4da5eca2f5a4030a84937de598a8f38)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.395251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.396907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 217/445] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/projects/a4da5eca2f5a4030a84937de598a8f38 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:26.397659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.423891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.424547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.424810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.425079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.426187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.427667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.429250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 229/446] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:26.430077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.469182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.508811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c3f7-40c4-4944-821e-570ede5676f5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.533003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a777df-354b-4c7b-916e-304a4f686f35 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.542007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.542652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.542929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.543227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.553228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:26.558345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:26.559352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:26.560219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 218/447] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:26.560853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.565035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.571486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.572128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.572408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.572681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] PATH_INFO: `/v3/groups/7af2c123902041f7abeafe26e948be94` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.573811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] RBAC: Authorizing `identity:get_group(group_id=7af2c123902041f7abeafe26e948be94)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.575292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.576894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 230/448] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/groups/7af2c123902041f7abeafe26e948be94 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:26.577637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.662010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8d46f-656d-41af-aa26-b1eecc03eec9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.678240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbec42e-30c0-46e5-8a71-f71cbb28ee83 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.684441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.696379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.696987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.697267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.697539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.698271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=1874aa7556d94cd1a5e671aefe930726) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:26.698943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.700052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.705812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 219/449] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=1874aa7556d94cd1a5e671aefe930726&role.id=56a6a91609874159a6cf397498dea0cd => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:26.706508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.713609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.714249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.714528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.714803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.715536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:26.715905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.717350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.727963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 231/450] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:26.733454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:26.802661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:26.840620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac07b8-43f8-4448-8cbf-b6306ee55616 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.856296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01011303-823c-466a-9f14-358e303ff1e0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:26.891166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.892165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.892941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.893174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.893982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] RBAC: Adding query filter params (group.id=7af2c123902041f7abeafe26e948be94, role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=a4da5eca2f5a4030a84937de598a8f38) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:26.894296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.896348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:26.902728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 220/451] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/role_assignments?group.id=7af2c123902041f7abeafe26e948be94&scope.project.id=a4da5eca2f5a4030a84937de598a8f38&role.id=56a6a91609874159a6cf397498dea0cd => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:26.904388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:26.905958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:26.905958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:26.905958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:26.988829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:26.990271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:27.055599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:27.103703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 232/452] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:27.110336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:27.163441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:27.215284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530a235-eb99-43f0-b231-8163f2a53c04 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:27.248813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:27.249464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:27.249742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:27.250015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] PATH_INFO: `/v3/projects/a1e6eefe19074b16ac82b646f2c6375a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:27.251157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] RBAC: Authorizing `identity:get_project(project_id=a1e6eefe19074b16ac82b646f2c6375a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:27.252666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:27.254315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 221/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:00:27 2022] GET /identity/v3/projects/a1e6eefe19074b16ac82b646f2c6375a => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:27.260195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:27.360526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b1de-10a1-47a9-94c1-5b0bd068ab15 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:27.397771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:27.398431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:27.398710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:27.398980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] PATH_INFO: `/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:27.400205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] RBAC: Authorizing `identity:get_group(group_id=c8d3fb38f98745e392647f1ecef5d0a7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:27.401676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c379f-87fb-4494-beae-6905355153a2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:27.403761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 233/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 13:00:27 2022] GET /identity/v3/groups/c8d3fb38f98745e392647f1ecef5d0a7 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:27.410012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:27.525481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a9c3-9b51-431e-870d-bbb8951c5aca None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:27.544846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:27.562609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:27.563225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:27.563525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:27.563800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:27.564530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] RBAC: Adding query filter params (group.id=c8d3fb38f98745e392647f1ecef5d0a7, role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=a1e6eefe19074b16ac82b646f2c6375a) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:27.564838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:27.566292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d8048-6a41-49dd-9347-2570ab52be1e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:27.571985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 222/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 13:00:27 2022] GET /identity/v3/role_assignments?group.id=c8d3fb38f98745e392647f1ecef5d0a7&scope.project.id=a1e6eefe19074b16ac82b646f2c6375a&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:30.014364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9413-6d80-4e6e-894c-6bd578fce47c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.014903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9413-6d80-4e6e-894c-6bd578fce47c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.014903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9413-6d80-4e6e-894c-6bd578fce47c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.016502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 234/456] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:30.022203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2f5d-8efb-4ac8-af82-598384dbeaf3 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.022688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2f5d-8efb-4ac8-af82-598384dbeaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.022842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2f5d-8efb-4ac8-af82-598384dbeaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.048952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c52a2f5d-8efb-4ac8-af82-598384dbeaf3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:30.050154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c52a2f5d-8efb-4ac8-af82-598384dbeaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:30.065470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a16312-0266-4516-ba20-12e216d4dd09 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.065739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a16312-0266-4516-ba20-12e216d4dd09 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.066192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a16312-0266-4516-ba20-12e216d4dd09 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.067701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 235/457] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:30.072861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fbcf-4b02-40f1-bc33-1cec68b82e70 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.073376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fbcf-4b02-40f1-bc33-1cec68b82e70 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.073847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fbcf-4b02-40f1-bc33-1cec68b82e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.101270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1389fbcf-4b02-40f1-bc33-1cec68b82e70 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:30.101270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1389fbcf-4b02-40f1-bc33-1cec68b82e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:30.133002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:30.169740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 223/458] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:30.199327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 236/459] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:30.403768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda33-a7b3-47bd-accb-c0212a1281ef None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.403768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda33-a7b3-47bd-accb-c0212a1281ef None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.403768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cda33-a7b3-47bd-accb-c0212a1281ef None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.403768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 224/460] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:30.408795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.409087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.409363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.428239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:30.429445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:30.466021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cda33-a7b3-47bd-accb-c0212a1281ef None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:30.525320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 237/461] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:30.652907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cda33-a7b3-47bd-accb-c0212a1281ef None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:30.674794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:30.703225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:30.703880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.704154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.704418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.717127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:30.718662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:30.731152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:30.744447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:30.745387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:30.746237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:30.746237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:30.746237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:30.746237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 225/462] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:30.754249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:30.864619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:30.876820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4240-a66b-4a82-8864-29afa86e2d37 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:30.902791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed251c9-66f9-41a7-b575-f31f98fc02d3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:30.911102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:30.911786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.912061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.912319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.922944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:30.924880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:30.938301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:30.938925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.939228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.939503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c63f53e9-c941-4d1a-8e11-dcbce27dca5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:30.939597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:30.940411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:30.941296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:30.941296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:30.941296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:30.941465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:30.941465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:30.941591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 238/463] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:30.942077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:30.942531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03dee-89d7-4230-96ee-f444c04332ef None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:30.942807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03dee-89d7-4230-96ee-f444c04332ef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:30.943072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03dee-89d7-4230-96ee-f444c04332ef None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:30.944485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 239/464] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:30.945080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03dee-89d7-4230-96ee-f444c04332ef None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:30.960678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 226/465] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:30.961971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:30.991710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.064094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03dee-89d7-4230-96ee-f444c04332ef None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.066949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc118170-e7e2-4476-8704-2fbd700000d6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.100226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.101084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.101484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.102057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.103112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.103755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.104035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.104307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.104949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:31.105248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.106680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f419-8d15-4030-9087-cb34a69f33cd None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.112577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.115415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.117090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.119702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 227/466] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:31.120986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.121266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.121535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:31.144030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:31.145057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:31.145879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:31.145879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:31.145879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:31.145879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 240/467] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:31.146088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.159161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:31.160373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:31.239342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 228/468] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:31.239342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.263700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.273723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654aea36-5244-4ed4-aa9b-e6a0c37af7a2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.309330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.310286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.310712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.310980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.311666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.313103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.347246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 241/469] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:31.347246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.368577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b966b4-1b0a-4a04-ab6a-d1c08487c52a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.407297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.425143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.426508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.426995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.427500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.428374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.431138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a28e9-1ff1-4a41-adbd-c5ac9d030f98 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.469344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 229/470] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:31.470806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49704022-0ae8-4ce7-8440-ad6cb0592269 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.471226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49704022-0ae8-4ce7-8440-ad6cb0592269 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.471533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49704022-0ae8-4ce7-8440-ad6cb0592269 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.475382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 230/471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:31.479712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.480369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.480851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.486512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ad5cf-3421-42e7-9a4f-106f04efa980 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.501536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:31.502787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:31.537999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.538935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.539540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.539961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.541124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:31.541718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.543615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.557218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 242/472] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:31.558188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.597559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.603082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 231/473] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:31.604288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.725162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f58f2-ca05-45fc-b9cf-f0429a17c84e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.725945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e3a07-65be-4026-9083-2a7cf8bf26ea None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:31.736886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.769378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.770247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.770676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.770949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.771645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:31.771807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.772631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:31.773061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:31.773183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.773616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:31.787335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:31.789282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:31.800731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 232/474] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:31.807674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:31.808837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:31.809986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:31.809986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:31.809986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:31.812015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 243/475] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:31.818452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.894868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:31.926817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:31.955549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe19f-a80d-48a8-bb7a-bd146f746649 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:32.002189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:32.003078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:32.003078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:32.003383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:32.004035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:32.004338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:32.005734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:32.021405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 233/476] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:32.027936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:32.073261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a8813-8106-407a-80d1-4403ef626979 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:32.119604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:32.121031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:32.121505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:32.122095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:32.123034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:32.124882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:32.136416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.sql.core [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 13:00:32.136416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 13:00:32.136416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [parameters: {'id': '6aa828f0b9304b09af640ae0c931df8a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 13:00:32.136416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:00:32.159514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:00:32.160570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application yield resource Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise self.value Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application session.commit() Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 13:00:32.161643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.flush() Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application compat.raise_( Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 13:00:32.162669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:00:32.163717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:00:32.164697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [parameters: {'id': '6aa828f0b9304b09af640ae0c931df8a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:32.165612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 13:00:32.166558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.167633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bc15-74d0-4947-b682-dd5d74f7dcf3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:32.171223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 244/477] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 13:00:31 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:32.178834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:32.188844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:32.212499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:32.213017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:32.213387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:32.213785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:32.214542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:32.216891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:32.217647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:32.257806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 234/478] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:32 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:00:32.333700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c3efe-66f2-4eda-a1b4-9c18efda257c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:32.372746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:32.373769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:32.374242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:32.374702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:32.387665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-56fb2348-9525-42fd-948d-3b88d9f16ee6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:32.393397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:32.394266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 13:00:32.395041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:32.397772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 245/479] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:32.405961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:32.521380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0225f6-f4bc-4c51-96b5-40978cf9a8f7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:32.568691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:32.569328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:32.569602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:32.569868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:32.570604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:32.570904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:32.572429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6220c-2b0b-405a-8075-0dbd3a8be835 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:32.585647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 235/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:33.815981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9cae-c6c1-4489-984a-d6cc3731e411 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:33.816532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9cae-c6c1-4489-984a-d6cc3731e411 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:33.816532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9cae-c6c1-4489-984a-d6cc3731e411 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:33.818094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 246/481] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:33.823470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee963-6e6c-4f54-84cf-745917ff854e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:33.823910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee963-6e6c-4f54-84cf-745917ff854e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:33.823997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ee963-6e6c-4f54-84cf-745917ff854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:33.842408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-079ee963-6e6c-4f54-84cf-745917ff854e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:33.843627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-079ee963-6e6c-4f54-84cf-745917ff854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:33.881670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:33.933558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 236/482] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:34.211855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9cae-c6c1-4489-984a-d6cc3731e411 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.224671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49583ab-4dc2-4bb5-821d-7c67784278ab None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.224998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49583ab-4dc2-4bb5-821d-7c67784278ab None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.225216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49583ab-4dc2-4bb5-821d-7c67784278ab None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.226826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 237/483] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:34.232152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e316-3414-4537-a4d2-df9d284e1557 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.232485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e316-3414-4537-a4d2-df9d284e1557 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.232683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e316-3414-4537-a4d2-df9d284e1557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.268177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c2b9e316-3414-4537-a4d2-df9d284e1557 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:34.269377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c2b9e316-3414-4537-a4d2-df9d284e1557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:34.302769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:34.320252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9cae-c6c1-4489-984a-d6cc3731e411 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:34.350502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 238/484] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:34.352374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388de9-1245-4c58-80d5-1d7b07a53926 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.352829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388de9-1245-4c58-80d5-1d7b07a53926 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.353264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388de9-1245-4c58-80d5-1d7b07a53926 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.354172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:34.354803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.355076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.355371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.356210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 239/485] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:34.361594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.361844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.362138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.381453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:34.382816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:34.390936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:34.395974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:34.396856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:34.397660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:34.400232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 247/486] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:34.408228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.484419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 240/487] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:34.552659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56d71-a072-4418-85ec-358219285cff None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:34.596836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:34.597447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.597720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.597984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.598646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:34.598940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:34.600399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:34.619870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 248/488] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:34.629040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.687352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:34.692060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.702232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:34.800028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1382-6952-4b75-a9bb-9f344e9ade9e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:34.821714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd36f6-43bd-4944-bde3-dca5dbd212aa None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:34.836320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:34.837108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.837478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.837845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.849764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:34.857477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:34.858575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:34.859525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:34.860227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 249/489] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:34.861626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.868470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:34.869721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:34.870167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:34.870600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:34.887170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:34.888934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:34.911476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:34.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:34.913271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:34.913271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:34.913271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:34.913271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 241/490] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:34.915454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:34.950772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:34.990933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea08df2-3fe1-43d8-b9de-d68656ee38c1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.009403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.031286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.032280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.032714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.033136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.034551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efe1d-8838-4893-b39b-ea5de3ba5792 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.045011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:35.050848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:35.051942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:35.052904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:35.055024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 250/491] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:35.056226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.073753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.074687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.074794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.075140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.075855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.076163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.077581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.087509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 242/492] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.088392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.170571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953233b-536f-41a7-b5c2-de3c9da948a0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.194397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a832b8-55bd-4b70-8a4d-bbcab0217209 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.196993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.207727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.208342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.208619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.208893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.209544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.209833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.211270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfbd4c-cf38-4d5b-a3b1-9c4c9f1bf439 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 251/493] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999981-b0ea-4426-8772-f76c3773c509 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999981-b0ea-4426-8772-f76c3773c509 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999981-b0ea-4426-8772-f76c3773c509 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 252/494] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:35.228510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a999981-b0ea-4426-8772-f76c3773c509 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.242335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.243088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.243600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.243959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.245203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.245801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.247551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.253753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.258063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 243/495] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.259220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.332345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a999981-b0ea-4426-8772-f76c3773c509 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.363583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b0773-6e0b-499d-8e49-005e1988964c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.371572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.372272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.372545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.372815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.384332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.385793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-db349091-557e-419b-b04e-29c37dd20ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:35.400362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:35.401425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:35.402283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:35.402283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:35.402283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:35.402283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 253/496] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:35.403657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.404276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.404377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.404553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.404641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.404796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.404870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.413373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.414885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-1284092e-074b-4632-a8a2-c6549994ae62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:35.428071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:35.429008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 244/497] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:35.430407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb393f-0108-4007-81fa-abc6556dc20d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.431509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb393f-0108-4007-81fa-abc6556dc20d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.431509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb393f-0108-4007-81fa-abc6556dc20d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.431695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:35.432327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 245/498] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:35.432853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb393f-0108-4007-81fa-abc6556dc20d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.433607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:35.465950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.500853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.507582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 254/499] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:35.508486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.562363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb393f-0108-4007-81fa-abc6556dc20d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.598595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.599286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.599564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.599834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.613182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.615461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.627934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5655bf-e914-4d4c-9014-8109561b8e57 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:35.634505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:35.635438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:35.636366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:35.636366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:35.636366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:35.637050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 246/500] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:35.638272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.668986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.670041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.670494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.670937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.671813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.672325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.673683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dc0c4-6887-4745-83db-9b9a24cb01de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.685719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 255/501] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.687033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.687353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.687627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.706035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:35.707410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:35.732058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.753774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39fce-9212-4f69-9447-0aab2c7036ee None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.766776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.782666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 256/502] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:35.783640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.789031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.789645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.789924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.790194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.790927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.791262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.792713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.833373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 247/503] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.833373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.897937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd9caf-3edd-42a9-97ac-3fc66d4f679b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.933991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.934908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.935402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.935532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aebc-056a-495d-8fac-a85b9940f090 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:35.936306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.937131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:35.937607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.939159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:35.954061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 257/504] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:35.955329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:35.976010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:35.977342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:35.978184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:35.978472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:35.978772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:35.986383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:35.987898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:36.002469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:36.003435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 248/505] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:36.009061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.041563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.067632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b1b4-c3e5-44a8-a1c4-66e7b1a59a14 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.100446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.101052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.101331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.101604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.111874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed8106-1ac0-42e8-89f5-9e73ce0aab12 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.112035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:36.116970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:36.118003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:36.118827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 258/506] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:36.120435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.145421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.146039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.146395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.146585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.195657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.214879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.216552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.218830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20fd1-d448-439a-a40a-a5167adf4ddc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.245162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.253196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.253832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.254110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.254384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.261896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.263538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:36.276146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:36.277216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 259/507] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:36.283546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.315998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 249/508] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:36.316848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.382730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40222fc-105c-46bb-948e-e79a7ceeb4cd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.414799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29245d-d36b-4590-b0c2-c563c92c66c2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.416376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.417073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.417415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.417750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.418470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:36.418770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.420248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.437898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.442555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.448901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.449464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.449737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.450030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.460701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.461135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 260/509] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:36.461938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.462186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:36.477738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:36.478715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:36.479593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:36.479593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:36.479593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:36.479593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 250/510] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:36.479810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.579066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a1b7-be73-4015-b008-c8d25c81d2c9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.601086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06311d1a-2ef1-4d16-821e-76cf637f9b84 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.620889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.621507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.621783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.622055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.622729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:36.623033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.624460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.632780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 261/511] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:36.633559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.636002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.636595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.636873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.637160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.638165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:36.638468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.639959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.658019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 251/512] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:36.658844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.699989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.702510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.743220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25796b-d6ca-4f67-a5aa-bfb50095c13f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.762168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70a31-3674-4970-871e-568afef8a26a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.777761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.778743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.779015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.779314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.789924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.791505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.797576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.798189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.798468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.798741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:36.805543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:36.806540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:36.807416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:36.807416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:36.807416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:36.807416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 262/513] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:36.807657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.874044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.875612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.914518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf4c9-a40a-4c46-ab79-b32770297568 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:36.921937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.926257 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:36.950781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:36.951333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:36.951609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:36.951876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:36.952508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:36.952803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:36.954178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:36.966184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 263/514] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:36.966983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:36.982961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 252/515] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:36.983900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.077456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f29a98-daf1-475b-bb03-af4da51e970a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.084445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7679-6f54-4c14-abc7-0457b42e8a7a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.110461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.111093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.111393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.111660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.118697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.119353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.119631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.119902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.122004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.123522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.135994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:37.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:37.143642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:37.144928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:37.144928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.144928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:37.144928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 264/516] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:37.144928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.170482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.200303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.201870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.244832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494caf4-6e77-4442-b964-bd949787c4ec None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.279031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.279673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.279947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.280213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.280849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:37.281148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.282520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.295994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 265/517] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:37.296898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.307063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 253/518] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:37.308082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.352360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.378618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.406845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a60bf-ed0c-4b16-9235-af331edc1761 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.409291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdddbec-2178-4ab6-ae86-d8a004052fc9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.442781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.443314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.443451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.443688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.443953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.444045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.444230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.444500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.444603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.446032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.454553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.455977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.467428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 266/519] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:37 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:37.468479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:37.470418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:37.471512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:37.472479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:37.472479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.472479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:37.472479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 254/520] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:37.472479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.596242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76c531-006e-4f2c-bd8a-7b007c299eba None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.599607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.618080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4dcd4-2060-4578-8d32-9f0dac4bd1f2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.644553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.645479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.645479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.645845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.646710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:37.646710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.648872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.657800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.660246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.660895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.662827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.662827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.665848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 267/521] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:37.666917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.669469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.671001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:37.687920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:37.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 255/522] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:37.693659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.789256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f19883-70c0-4267-b9d8-c21213d8c904 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.810153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579349a-ba1e-4329-9837-35b3e919abe9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:37.831392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.832246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.832663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.833186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.851929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.854508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.855261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:37.856231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:37.856735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:37.857171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:37.858182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:37.858686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:37.860788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:37.879769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:37.880697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:37.881650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:37.881650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:37.881650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:37.882224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 256/523] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:37.883547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.888403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 268/524] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:37.889672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:37.908098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:37.948696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.003085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c19d6-05d3-46e4-a38e-f6b1cedb206c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.006319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768310-b9ad-4223-871e-038a86c17ac8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.044574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.045109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.045516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.045794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.046032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.046494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.046786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.046886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.047065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.047359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.048519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.056038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.057498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.071725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 269/525] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.071725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:38.071967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:38.072774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 257/526] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:38.073745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.156721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.189641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25da2-a479-4859-afd2-7a331ccd926b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.189923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed060cd-96e1-4780-83e5-44dfef2d10b3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.202159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.226769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.227405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.227683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.227953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.228596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.228897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.229652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.230287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.230595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.231112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.231835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.240476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.242121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.247052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 258/527] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.247052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:38.254439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:38.255294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 270/528] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:38.257536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.355381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261ad3-389c-4482-8ebb-9d1d383ff127 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.361727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47901b31-8b6b-4bd6-b1c2-5be02116ccbb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.385211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.391210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.392059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.392342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.392670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.393400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.393707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.395157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.399589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.400200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.400476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.400993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 259/529] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.401829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.403574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.404598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.405245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.407951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.434742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 271/530] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.435968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.477468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.538260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8de1-2970-4411-ad45-38f15a6cdb4b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.563600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb26be-e2cb-4139-b1af-5681bb13cf68 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.580478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.581580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.581856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.582124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.590499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.592311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:38.605293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:38.606261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:38.607547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 260/531] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:38.619858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.625046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.625945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.626410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.626889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.627792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.628786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.630849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.647629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 272/532] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.649537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.684438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.731949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be22d3-40fa-466a-b0bb-eb224d34dac2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.773579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.776715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.777348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.778905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.779223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.789361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082cf68-0631-466d-a45f-8e603fc9e0b0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:38.836328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:38.837199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:38.837480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:38.837778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:38.838921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:38.839501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.841590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.858754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 273/533] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:38.860003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:38.862580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:38.864352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:38.925441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:38.973605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 261/534] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:38.974487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:39.000183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fb37b-5b4d-41e8-8156-3b72bfa801fa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:39.050216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:39.052038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.052513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.052932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.053835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=6c2ed0e5eabf49d2816ab27e21e54985) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:39.054287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:39.055957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:39.069338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 274/535] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/role_assignments?user.id=6c2ed0e5eabf49d2816ab27e21e54985&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:39.069338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:39.105961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:39.125104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7e5d-6a9f-4e4f-b65f-8442d7aa8e40 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:39.194146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:39.194772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.195044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.195336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.196077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=b99f8096be0f41399f34257c8a1cd5ac) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:39.196378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:39.197859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:39.211784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 262/536] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:38 2022] GET /identity/v3/role_assignments?user.id=b99f8096be0f41399f34257c8a1cd5ac&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:39.271601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8deaf-4717-4ded-ab7c-85e20bfb178d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:39.309991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:39.310648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.310926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.311208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.323630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:39.325277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-28a12f66-51d3-4f03-afaa-610dccce08a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:39.348983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:39.349930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:39.351265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:39.351265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:39.351265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:39.351265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 275/537] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:39.356368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:39.400875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:39.444490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2037e-0446-4195-bd55-7c41a5688ff8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.444795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2037e-0446-4195-bd55-7c41a5688ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.445017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2037e-0446-4195-bd55-7c41a5688ff8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.446637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 276/538] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:39.451854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.452138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.452413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.490474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:39.493158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:39.505280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2a43-bd72-4646-ba41-10403eb134a2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:39.586620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:39.587278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.587561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.588081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.588756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:39.589063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:39.590534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:39.598676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:39.625494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 277/539] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:39.626744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 263/540] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:39.633463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:39.742671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ce75-9821-420e-9f2a-b968bef3fd1d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:39.787976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:39.788635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:39.788919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:39.789197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:39.796861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:39.798337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:39.814672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:39.815631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:39.817009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 278/541] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:39.821786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:39.939404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:39.965418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86377a-52b1-428d-9103-6dd6ec016ae4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.012303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.012930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.013214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.013525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.014237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:40.014548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:40.016039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:40.042512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 264/542] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:40.048120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:40.050809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:40.155713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:40.242285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15caf-79d7-4701-82db-7e4c8a0e6f34 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.245794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72211-fbcd-4b1e-bbb8-6333099a4c89 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.290977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.291561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.291840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.292111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.311655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:40.318656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:40.323486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:40.324350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:40.325197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:40.328918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.329543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.329817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.330087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.330831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=3509a6c850854eb7904672398e2d6cbb) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:40.331212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:40.332684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:40.334671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 265/543] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:40.335587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:40.344046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 279/544] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/role_assignments?user.id=3509a6c850854eb7904672398e2d6cbb&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:40.452898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841deba-0a61-4ad2-9821-758bc8e8eab2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.498532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.499198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.499455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.499734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.500412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:40.500717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:40.502124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2eeee-a548-44e7-b07b-5dfe77b2ecab None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:40.512424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 266/545] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:40.518406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:40.635970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09416-0764-45cb-a78b-5c8b4de9279b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.654280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:40.675799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159177ee-b53c-44b6-a8f5-dba2c192c945 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.676143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159177ee-b53c-44b6-a8f5-dba2c192c945 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.676351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159177ee-b53c-44b6-a8f5-dba2c192c945 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.677702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 267/546] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:40.684990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.685157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.685256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.685539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.685636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.685901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.686172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.697808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:40.699419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:40.715750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:40.716647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:40.717467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:40.717467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:40.717467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:40.720361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:40.721053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 280/547] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:40.721995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:40.741448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:40.803121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:40.816814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 268/548] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:40.901648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21684ab6-3ce2-4a68-834a-a0524b5646d1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:40.959927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:40.960561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:40.960841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:40.961112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:40.961782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:40.962084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:40.963502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:40.980519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 281/549] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:40.985708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.108906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfad2-ced2-4182-b338-3637b3d22752 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.136526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.153904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.154479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.154797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.155085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.168959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:41.172232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:41.190538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:41.192017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:41.193075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:41.195271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 269/550] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:41.195779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.200465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.300255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad857-0f4d-473a-93f9-2b5702668965 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.309846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.338954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.340023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.340524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.340971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.351833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:41.357042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:41.357951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:41.358756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:41.361097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 282/551] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:41.370590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.398932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729aa7-e873-4637-ba6d-7bd4c4e2f1d2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.442065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.445117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.445117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.445117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.445117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:41.445117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:41.446699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791515d9-cab2-4d10-a029-c51e0eb2f3ea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:41.469570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 270/552] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:41.471158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050309d1-76a6-47d5-87e5-cf75260f1ae1 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.471463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050309d1-76a6-47d5-87e5-cf75260f1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.471880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050309d1-76a6-47d5-87e5-cf75260f1ae1 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.473655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 271/553] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:41.475289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050309d1-76a6-47d5-87e5-cf75260f1ae1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.483305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.495459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976236-67e2-4a2e-9851-38b45b39eb5f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.538155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.538863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.539226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.539937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.540688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:41.541129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:41.542646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f36d-6373-44d4-bf53-f4273747ece7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:41.555228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 283/554] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:41.555521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecf0e-c86f-4195-9cb1-f2d4548beead None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.555800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecf0e-c86f-4195-9cb1-f2d4548beead None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.556073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecf0e-c86f-4195-9cb1-f2d4548beead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.573932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-069ecf0e-c86f-4195-9cb1-f2d4548beead None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:41.575175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-069ecf0e-c86f-4195-9cb1-f2d4548beead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:41.599857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050309d1-76a6-47d5-87e5-cf75260f1ae1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.612392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.637762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.638641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.638920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.639216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.655573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 284/555] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:41.660966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130755-6103-498e-883f-01ddfc6b7f16 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.661504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130755-6103-498e-883f-01ddfc6b7f16 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.661972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130755-6103-498e-883f-01ddfc6b7f16 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.664755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 285/556] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:41.665818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1130755-6103-498e-883f-01ddfc6b7f16 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.735934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:41.737763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748507-3692-4bb6-90e5-a5d28c35ed1a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:41.758149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.779732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1130755-6103-498e-883f-01ddfc6b7f16 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:41.830852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:41.832103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.832237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.832480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.849928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:41.852441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:41.869987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 272/557] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:41.871427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:41.871780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:41.872056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:41.875013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:41.876153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:41.877277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:41.877277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:41.877277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:41.879342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 286/558] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:41.880582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.897280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:41.899013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:41.904216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:41.983219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 273/559] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:41.983219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:41.999484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfe36-12bf-4fe7-b32a-76abeba635c8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.043289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.044177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.045066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.045442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.048844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.059136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:42.080703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.082137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:42.083461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:42.083461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:42.083461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:42.083642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80686-946e-4df2-a81b-0684e94da496 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.083725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 287/560] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.083725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.124024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.124649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.124929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.125456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.126516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.126826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.128507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.139679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.147390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 274/561] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.149426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.218694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055ed81-a76c-4a99-9c3a-b639bb81a130 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.256683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.257723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.258201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.258762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.265295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f099790-2e6d-4d6f-aa4e-f4e0d15bce0a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.270928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:42.276896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.277805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:42.279073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:42.283305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 288/562] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.284175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.301230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.301853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.302178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.302452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.303094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.303420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.304820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.317218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 275/563] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.318036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.343556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.386697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.411513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e63c-f01f-446e-93c0-31ea065db980 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.431479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876f16d-8a0e-4c86-a538-8d55fd98b83d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.449851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.450583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.450929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.451298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.460638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.462263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.469422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.470358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.470632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.470896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:42.474847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.475969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:42.477072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:42.477799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 289/564] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.478630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.490063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:42.495764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.496741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:42.497551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 276/565] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.498239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.593412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53428e91-f110-488d-b879-66520f6f9668 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.600780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.613605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820a12c-2898-4124-a3ba-2d2f49e661e0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.630368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.630977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.631281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.631553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.632216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.632515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.633943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.634604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.647097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 290/566] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.647958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.649383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.650025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.650305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.650584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.658224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.659737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:42.670791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.671739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:42.672626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 277/567] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.673091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.750016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bdf4d-dc4a-47dd-b00b-140525daa052 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.771380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d4be-7884-4b09-b53f-2a47b57cb384 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.800352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.800968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.801246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.801519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.802328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.802657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.804138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.804867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.805500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.805761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.806032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.806678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.806983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.808399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c8ba-1257-4f48-a099-b227906068a6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.816509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 278/568] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.817705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2767-e33b-457a-b891-f8921c00d5bc None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.817989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2767-e33b-457a-b891-f8921c00d5bc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.818260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2767-e33b-457a-b891-f8921c00d5bc None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.819504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 279/569] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:42.820186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2767-e33b-457a-b891-f8921c00d5bc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.825479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 291/570] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.826317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.858931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.866468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:42.926638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2767-e33b-457a-b891-f8921c00d5bc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.942328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe722-1187-439e-b2b5-dba9716cc30d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:42.960817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.961445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.961720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.961983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.973955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.975471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.976737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:42.977345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.977622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.977894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:42.978586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:42.978891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:42.980367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad581f5-826e-47ee-a5be-441dc3de59e5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:42.990478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:42.991443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:42.992286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:42.992286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:42.992286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:42.992286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 280/571] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:42.997922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:42.998046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 292/572] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:42.998046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:42.998046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:42.998046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.013320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:43.014559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:43.080699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 293/573] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:43.081759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.092196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.099168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed23fc2-eec8-49ca-9591-9d5ed229dae1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.107902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.142030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.142582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.142866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.143135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.156391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.157888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:43.172390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.173339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:43.174184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:43.174184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:43.174184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:43.174184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 281/574] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.174412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.204082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76dce-dc9f-4c48-a669-4b66b63b7fc3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.240623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.241283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.241511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.241822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.251937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.253397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:43.268990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.269896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:43.270791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:43.270791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:43.270791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:43.270791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 294/575] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.271008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.283647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661fa3d-7e45-4209-8590-80142c13021a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.318512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.319827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.320102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.320375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.321019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:43.321315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.322786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.334760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 282/576] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:43.335577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.346302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.349008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.382941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4f7db-258f-4269-b34d-113e9ffc1456 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.416313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.416833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.417106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.417371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.418087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=79dc27d463f446a3a8da3aff55b6603e) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:43.418388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.419888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.425242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 295/577] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/role_assignments?user.id=79dc27d463f446a3a8da3aff55b6603e&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:43.426007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.439411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf1815-33ea-4bcd-8878-331493cae66a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.483113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.483846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.484129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.484391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.485053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:43.485352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.486807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.499611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 283/578] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:43.500488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.561979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4cee-3be9-4620-8158-54eba320580d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.573876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.598233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.604278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.604924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.605203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.605483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.611410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:43.611410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.611410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.625511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 296/579] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:43.625708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32e51-64a9-411e-befe-02e0350fe7a6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.625819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.667766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.668319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.668659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.669329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.678837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.680378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:43.692536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.693493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 284/580] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.699325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.740607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0389f-420b-4a8e-90e0-c3c9ae8820e3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.776049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.776825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.777100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.777365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.787966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:43.792779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.793752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:43.794561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 297/581] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.796326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.809269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23db6-be97-4e9c-b451-1aeb063fc58e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.834909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.847006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.848090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.848892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.849572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.854699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:43.859864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.862067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:43.877443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.878425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 285/582] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.884474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.917899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2900e-51a2-42f7-82bd-dd92a1cdd0b9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:43.953180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:43.953808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:43.954091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:43.954354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:43.962163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:43.964082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:43.976066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:43.976955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:43.977823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:43.979676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 298/583] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:43.980726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:43.992535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d925e-7050-4c72-b0eb-c5352212ec64 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.031635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.032251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.032528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.033024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.033561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.033863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.035348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.055669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 286/584] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.057013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.088279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22299c-f18b-49eb-a02d-ff5126c2e501 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.102387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.105028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.131122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.131764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.132039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.132320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.132982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.133282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.134665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.143248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 299/585] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.143913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.183982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ccd1f-c849-4b5e-a7fd-1fcb5de4ead2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.219876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.220493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.220777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.221051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.221786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.222119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.223603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.241738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 287/586] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.242725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.261894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323cedc-a85a-4fdf-aa56-605f741bb0cb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.297604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.298227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.298500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.298772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.299503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.299807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.301242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.319219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 300/587] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.319219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.354971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.355320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1d442-a8d2-4fdb-91f7-a4da7cbdffe0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.357125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.404607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.405260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.405542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.405815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.416579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.418064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.427277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b84e4b-966b-4a0d-8153-1992c93d7de9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:44.433008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:44.433958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:44.439629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:44.439629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.439629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:44.439629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 288/588] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:44.439629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.469841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.470502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.470780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.471052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.484762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.486938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:44.502600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:44.503789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:44.505012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:44.505012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.505012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:44.508482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 301/589] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:44.509322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.551043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cdd9c-a8a6-474d-bd10-1955dccba35a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.585487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.586122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.586394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.586659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.597797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.599288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.604191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:44.619618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:44.620704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:44.621983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:44.621983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:44.621983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:44.626547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 289/590] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:44.627593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.628574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4aee-351c-4139-becd-4437adf3cddd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.637419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.666157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.667080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.667393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.667723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/38517e3148874268801b6c81529aa789` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.684381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=acc4c0a07dfa4d738ce279cafb5fd3e0, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.685850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.700446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 302/591] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:44 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:44.701197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.754461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd0f0-85a5-42f3-888f-ab7e0974c213 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.805028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.806161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.806540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.806917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.808166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.808746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.810954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.830126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 290/592] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.830126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.845268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dba5e-a88f-49d6-8f66-e56a42a196eb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:44.893042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:44.893923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:44.894203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:44.894469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:44.895118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:44.895471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:44.897013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:44.900461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.912050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 303/593] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:44.912789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:44.949397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:44.987227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d952d-5364-45c5-8ba6-aab1518dde83 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.023747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.024529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.024895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.025263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.026011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:45.026409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.027942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.034531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f4c08-8055-45f4-b778-5afa1e13ed50 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.044754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 291/594] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:45.044754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.077894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.078921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.079392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.079861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.088104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.090028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:45.102886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:45.103957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:45.104820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:45.111479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 304/595] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:45.112693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.145844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07e0d-f08e-4f27-a821-fcc2421b1b7b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.173368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.177772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.183961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.184847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.185227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.185600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.195004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.196719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:45.209993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:45.211090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:45.212048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 292/596] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:45.212680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.248787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e84d0-6776-403a-b59b-e931304a6303 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.286598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.288066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.288537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.289015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.296754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.298576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:45.312758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:45.313692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 305/597] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:45.320055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.332537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19f28-6cf8-49cb-886c-d8573cdd88d1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.369737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.370424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.370676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.371158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.371669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:45.371975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.373436 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.385954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 293/598] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:45.386777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.439164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.440635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a747-a8ef-4a55-84ec-f815b3767017 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.457755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.477302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.477911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.478244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.478598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.479356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:45.479683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.481155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e305e0-3982-407f-8cb4-3c919d92b762 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.503638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 306/599] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:45.503802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857daa0-c34c-4851-8b13-4becdc53d9a1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.503900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b936-2ceb-46ba-91e3-e920e21eecc7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.503900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b936-2ceb-46ba-91e3-e920e21eecc7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.503900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3b936-2ceb-46ba-91e3-e920e21eecc7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.503900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 307/600] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:45.503900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3b936-2ceb-46ba-91e3-e920e21eecc7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.543313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.543968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.544248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.544520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.545215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:45.545522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.547007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.565173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 294/601] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:45.565173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.628868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3b936-2ceb-46ba-91e3-e920e21eecc7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.671749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.672421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.672697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.672966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/b99f8096be0f41399f34257c8a1cd5ac/roles/38517e3148874268801b6c81529aa789` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.675914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15744dc0-cd05-4652-9144-90460ec2d553 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.685875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.688985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=b99f8096be0f41399f34257c8a1cd5ac, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.690456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dfb82-7107-403b-82d9-126017cb2cb2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.706640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 308/602] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:45 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/b99f8096be0f41399f34257c8a1cd5ac/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:45.707869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.708153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.708421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.738333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:45.741640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:45.743574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.744243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.744575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.744860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:45.757455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:45.758925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:45.778093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:45.779471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:45.780524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:45.780524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:45.780524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:45.780524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 295/603] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:45.780745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.781803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:45.843899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 309/604] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:45.844811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:45.946503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe761-d6a1-4841-b7aa-382116f19a7e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.974291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69412b-ee84-431e-abfc-af1ed1d0ee8c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:45.987475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:45.988523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:45.989003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:45.989477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/6c2ed0e5eabf49d2816ab27e21e54985/roles/38517e3148874268801b6c81529aa789` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.005624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=6c2ed0e5eabf49d2816ab27e21e54985, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.007522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.018870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.019535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.020061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.020339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.020998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:46.021651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.023518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.026634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 296/605] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:45 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/6c2ed0e5eabf49d2816ab27e21e54985/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:46.037341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 310/606] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:46.043164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.061586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.192896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.205346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881aab-766f-4160-97ef-0e2ebbe77d7a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.211948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.272039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.272796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.273195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.273570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.291066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.292868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:46.314669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:46.315898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:46.316835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:46.323121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6e90-ca5f-41bd-9ed7-f8f5920ea24b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.323889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 297/607] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:46.331625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.375408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.376067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.376439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.376724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.394465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:46.401658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:46.402854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:46.404260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:46.407278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 311/608] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:46.410909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.423487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.462633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098638d9-a766-47a1-b6cd-895fa153230b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.491558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.502386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.503322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.503757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.504181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.505032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:46.505628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.507386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.521239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 298/609] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:46.525152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ecd2-b94a-404c-9dfc-8491c0a43016 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.527609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.566962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.566962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.567341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.567516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.568186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:46.568485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.569878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.583451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 312/610] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:46.585127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.648170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2dab3-6676-433c-b3a9-3550c0088dc1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.678719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.687809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.688824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.689258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.689729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/3509a6c850854eb7904672398e2d6cbb/roles/38517e3148874268801b6c81529aa789` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.699506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34ea8-dc0a-456a-a517-7eb5719d97f6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.707578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=3509a6c850854eb7904672398e2d6cbb, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.709414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.726378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 299/611] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:46 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/3509a6c850854eb7904672398e2d6cbb/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:46.738845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.739619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.739947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.740226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.744073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:46.755495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.757117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a8e0af66-22d2-453c-8196-a8208fafa655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:46.775007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:46.776290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:46.777383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:46.777383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:46.777383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:46.777383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 313/612] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:46.783123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:46.794085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade2da-148d-410d-a133-df172018b115 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.794367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade2da-148d-410d-a133-df172018b115 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.794640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade2da-148d-410d-a133-df172018b115 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.797341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 314/613] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:46.806652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.806940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.808109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.843511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:46.845510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:46.953361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0dadc-8869-48b3-9488-d9a55cbf9e86 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:46.966315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 315/614] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:46.989596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:46.990217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:46.990496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:46.990766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:46.991525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:46.991741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:46.993135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:47.006319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 300/615] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:47.011529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.143412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bed19f-204a-41df-809d-ba1ebd4764dc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.162571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:47.180460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:47.181096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:47.181372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:47.181642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:47.189509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:47.190952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:47.202645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:47.203608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:47.205526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 316/616] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:47.210479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.265746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:47.358382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce8344-4c3a-4483-b87c-1721dfc8d529 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.372671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.415687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:47.417032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:47.417658 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:47.418278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:47.419677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:47.420378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:47.423133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:47.457666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 301/617] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:47.462392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.585416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf582065-c0af-4b3e-bd32-dc40b2099a91 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.596771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:47.603706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61259428-2be1-4039-8327-1aa7284fc6ec None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.655338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8520876-69c2-4194-a629-295d91644283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:47.656392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8520876-69c2-4194-a629-295d91644283 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:47.657608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8520876-69c2-4194-a629-295d91644283 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:47.658105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8520876-69c2-4194-a629-295d91644283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:47.670317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:47.671309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:47.671786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:47.672250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:47.682532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8520876-69c2-4194-a629-295d91644283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:47.684457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8520876-69c2-4194-a629-295d91644283 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:47.697049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:47.709633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:47.710577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:47.711395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:47.718644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 317/618] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-d8520876-69c2-4194-a629-295d91644283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:47.721923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:47.722827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:47.724804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:47.724804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:47.724804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:47.728343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.731875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 302/619] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:47.733746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8520876-69c2-4194-a629-295d91644283 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:47.815581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:47.928221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937322-d86f-4e1d-90fc-64b581017979 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.938848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8520876-69c2-4194-a629-295d91644283 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:47.974280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:47.974892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:47.975165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:47.975458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:47.976095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:47.976560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:47.977947 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:47.990910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 303/620] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:47.996743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.008005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:48.047935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.048564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.048838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.049106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.049780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:48.050076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.051486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.069651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 318/621] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:48.087796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.111456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676ac7-141a-4878-98f5-d46713ce7aba None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.149241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.149886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.150162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.150434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.157908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.159448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-99b3f8d6-708f-419e-8573-4d66f1af2c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:48.173925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:48.174846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:48.175755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:48.179884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 304/622] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:48.181109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060184-b656-4f09-99e9-f9156d3cac71 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.181390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060184-b656-4f09-99e9-f9156d3cac71 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.181658 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060184-b656-4f09-99e9-f9156d3cac71 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.183752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 305/623] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:48.185798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe060184-b656-4f09-99e9-f9156d3cac71 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.256644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:48.260849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:48.269737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9c9a4-51e8-40cf-8626-c5b6c82b6ff3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.295217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe060184-b656-4f09-99e9-f9156d3cac71 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.315244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.316770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.317517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.318045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.330210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.330829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.331107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.331409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.332099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:48.332400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.333869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d03d-b83f-498b-a7eb-39fd0daa1c12 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.334103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.336133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.351479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 306/624] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:48.352848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.353134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.353406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:48.354509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:48.355427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:48.356349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:48.356349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:48.356349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:48.359458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 319/625] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:48.360465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.378946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:48.380645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:48.463640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 307/626] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:48.464776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.492332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe69d-06c0-49ea-ba19-d59789b45cdb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.533969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.534653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.534934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.535223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/79dc27d463f446a3a8da3aff55b6603e/roles/38517e3148874268801b6c81529aa789` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.569976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=79dc27d463f446a3a8da3aff55b6603e, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.571476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.588421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 320/627] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:00:48 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/79dc27d463f446a3a8da3aff55b6603e/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:00:48.595393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:48.645456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a3fb-03c4-4d87-8aa4-dae173724384 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.687961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.688593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.688875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.689149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.689870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:48.690179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.691683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17594d-9ed6-4320-85fe-f1189aaf8682 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.705685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 308/628] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:48.711648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.736325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:48.760799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b50f-233f-4602-b1a9-0cf10bd3121c None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.761132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b50f-233f-4602-b1a9-0cf10bd3121c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.761344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b50f-233f-4602-b1a9-0cf10bd3121c None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.764863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 309/629] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:48.769564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.769843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.770113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.790354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:48.791657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:48.854955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e9a03-a3f3-45fa-a811-1e24869aab1b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:48.884316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 310/630] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:00:48.885525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.896711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:48.897088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:48.897374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:48.897910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:48.907380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:48.909014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:48.925803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:48.926888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:48.927885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 321/631] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:48.933293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:48.945696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.007206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0420-25ce-45e4-a76c-5ba5deadc0d8 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.012876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.045308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.045953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.046232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.046503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.061378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:49.068471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71012-3647-4305-8ca3-d45fd3c251d3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-084e30d4-8a9f-4614-b2f6-65c162ab75ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:49.070468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:49.072211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 311/632] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:49.073866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346ede-95be-4dd0-8d1f-ec9532fdf065 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.075377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346ede-95be-4dd0-8d1f-ec9532fdf065 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.075377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346ede-95be-4dd0-8d1f-ec9532fdf065 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.081326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 312/633] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:49.082251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346ede-95be-4dd0-8d1f-ec9532fdf065 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.126764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.127803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.128316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.129402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.130824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:49.131977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.134381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd0eb-3a23-4b14-8b73-9230a284e7c4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.160080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 322/634] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:00:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:49.161362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.161646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.161918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.181191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:49.182402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:49.209735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346ede-95be-4dd0-8d1f-ec9532fdf065 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.219963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.245681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.246300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.246632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.246900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.247777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:49.248182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.249588 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.257307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 323/635] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:49.257774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 313/636] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:49.258647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.258773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.320684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.375521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bfeb-8335-4912-a42f-55e1806ea82e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.393942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a653e2-e407-4db9-8924-61137dc51938 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.415886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.416881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.417327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.418586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.443984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.444717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.445105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.445400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.456702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:49.462814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:49.464228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.465489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:49.469048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 314/637] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:49.469968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.497767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.499903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.502108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.552848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.574153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada0c1-619c-4fbc-b99c-dec9cad7eeeb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.611215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.611215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.611215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.611215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.622504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 324/638] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:49.622504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.625638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.627129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:49.642132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:49.643071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:49.644002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:49.644002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:49.644002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:49.645405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 315/639] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:49.646393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.741974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d4645-92d9-4680-9a99-c7e86c7613cd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.751055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.772934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975fd7-d6b2-4438-820f-bdd337c8c7b0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.779783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.780405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.780680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.780942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.781621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:49.781926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.783342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.791769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 325/640] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:49.792873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.810204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:49.817000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.817675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.817933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.818645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.830725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:49.835943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:49.836838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 316/641] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:49.838221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.907431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75447ee-3adc-4422-bf52-0a7d40f29919 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.944495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.945128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.945395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.945677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.951991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab51220-6ace-4931-a9b4-3675593c0a12 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:49.956900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.958382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:49.972661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:49.973694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:49.974615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:49.974615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:49.974615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:49.974615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 326/642] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:49.974615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:49.992018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:49.992622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:49.992913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:49.993174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:49.993823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:49.994098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:49.995595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.007463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 317/643] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.012290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.016050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.042982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.082556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7cb0-6fbe-4e4e-8f9e-58590ca4f0ce None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.120040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.120671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.121019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.121269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.128866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620cd5f-465f-47fe-b592-249ff83f7f1c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.132280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.133726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:50.148644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:50.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:50.156643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:50.156643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:50.156643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:50.156643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 327/644] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:50.156643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.171929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.172643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.172981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.173314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.174046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:50.174406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.175899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.189691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 318/645] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.189691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.251569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.260818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186805a7-55c2-4d13-99d0-d547d70b16d1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.279681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.297126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa30fd-e0c2-4a37-94f1-90a741c1d5c1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.299850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.300461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.300739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.301008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.301654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:50.301953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.303358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.316452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 328/646] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.317100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.337608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.338244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.338582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.338942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.346984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.348569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:50.359876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:50.360859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 319/647] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:50.361764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.428620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d683df-4b45-4d02-b1e8-e18d4ba2bf76 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.466315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.467076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.467464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.467733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.468385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:50.468682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.470049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.475717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03864-04ef-4eb1-ad87-816b3d35a184 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.482852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 329/648] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.483677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.505070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.518840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.519588 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.519865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.520133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.525621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.536299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.537943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:50.554356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:50.556661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:50.558680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:50.558680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:50.558680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:50.558680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 320/649] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:50.559486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.613516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75cb53-d98d-4a6b-8262-2500795ea41c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.653070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.654220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.654595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.654983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.663759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.665354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:50.680493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:50.681467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:50.682336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 330/650] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:50.683405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.690328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca641a-04b9-4b31-8956-2752732d074e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.730505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.731160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.731545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.731817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.732560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:50.732866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.734332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.752775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 321/651] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.753674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.791795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.794892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:50.814549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a6f75-dcd3-4e93-84f4-8256a9928120 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.850341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.850967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.851272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.851518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.859608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.861121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.861437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4b349-7487-4f2a-8246-47f027b794e7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:50.872490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:50.874360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 13:00:50.876520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:50.879215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 331/652] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:50.879215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.901407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:50.902037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.902332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.902648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.903670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:50.903969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:50.905366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd3268-6f2e-4521-a744-905313d71b8c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:50.916885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 322/653] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:50.918102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b706913-0fab-4465-9cdd-b4f8148c01f7 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:50.918444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b706913-0fab-4465-9cdd-b4f8148c01f7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:50.918719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b706913-0fab-4465-9cdd-b4f8148c01f7 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:50.923462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 323/654] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:50.924211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b706913-0fab-4465-9cdd-b4f8148c01f7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:50.982297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505f991-b1aa-4e80-9f80-3e3e9f53cb16 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.016568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.017184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.017462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.017733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.018435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:51.018736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.020202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.023498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.031438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b706913-0fab-4465-9cdd-b4f8148c01f7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.032529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 332/655] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:51.033343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.050432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.072116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.072734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.073005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.073270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.129551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76a4cd-7eaf-49cf-b7eb-f211bbac1cb0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.139046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.140568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a569-97eb-40e3-96e4-8f6c868bc923 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.162989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.163628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.163905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.164172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.164904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:51.165206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.166627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.184490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 333/656] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:51.185312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.233753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.241391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 324/657] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:51.242697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.242979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.243270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.260714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:51.261928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:51.274143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.300267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258c736-6b0e-4808-9a0d-eac8e8be8db8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.329339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 325/658] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:51.332208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.333596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.334229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.334486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.334757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.342615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.344077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:51.356934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:51.357911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 334/659] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:51.358863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.449571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda06d-c1af-4647-81d5-8164087bc639 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.468594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5202481-fa6d-4769-ad2a-d174a36aaf88 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.473524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.485961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.486627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.487010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.487115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.487865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:51.488171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.489630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.503238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 326/660] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:51.503238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.518199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.519004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.519378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.519730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.523060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.615381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.616876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.628907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0abf45-fef5-4c84-9940-40de1f3009de None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.667311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.668057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.668375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.668648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.681825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.683582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:51.700019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:51.701142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:51.702021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:51.702021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:51.702021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:51.702021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 327/661] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:51.702021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.731613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 335/662] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:51.732845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.753559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.769759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.820679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ee34-c902-491e-bc07-50c1b49a2aea None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.844777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07852-255f-4667-83e1-dda92c967f4b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:51.854415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.855117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.855514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.855911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.856714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:51.857083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:51.858551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:51.876185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 328/663] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:51.877378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.885610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:51.886251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:51.886562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:51.886833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:51.897701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:51.903676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:51.904857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:51.905675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 336/664] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:51.906340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:51.985818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:51.990773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff8f3-da28-4bd6-b4b4-69ddcd2a0de1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.009657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.016711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38ebc-3d6f-4b53-82f8-4842292c6b2f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.033581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.034536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.035255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.035665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.036450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:52.036889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.038990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.054796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 329/665] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:52.054796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.056865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.057515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.057794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.058063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.069708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.071225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:52.086827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:52.092797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:52.093864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:52.093864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.093864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:52.093864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 337/666] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:52.093864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.170491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df62dc-3d42-4c98-a5b9-f5d89b6bbd1d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.202624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6b2e7-08d8-4a10-bd8e-2472afa7f0c6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.207691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.208389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.208738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.209077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.237106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.240303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.240918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.241194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.241462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.242119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:52.242421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.243815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.258392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 338/667] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:52.258392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.270627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.281547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.283063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.368246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5372f-7094-42b3-a60d-bafc1d9e435d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.384103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 330/668] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:52.384103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.412274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.413202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.413477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.413750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.421198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.422647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:52.434096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:52.435160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 339/669] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:52.440951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.452642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.498935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ca52-a709-435a-a577-40f7a328ce01 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.512676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.537265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.537614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.537771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.537930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.538584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:52.538584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.540238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.552742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909da1-cbd2-4dce-b7d1-cf83dc4d42f8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.557462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 331/670] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:52.557462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.592430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.593195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.593538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.593878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.605600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.609372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:52.627357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:52.628897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:52.629967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:52.629967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.629967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:52.634519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 340/671] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:52.635406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.676328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8e06-0fd0-4659-a4ce-dafde9b05f93 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.696197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.714220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.714864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.715220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.715503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.726248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.727771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:52.741892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:52.743077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:52.744004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:52.744004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:52.744004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:52.744004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 332/672] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:52.744004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.753733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaf168-cb19-4bc2-8176-a904b2e069f1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.776307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.793256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.794057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.794398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.794678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.795399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:52.795710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.797443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.812210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 341/673] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:52.812804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.855597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead9a3-5978-45ab-8d6a-f956c5f58cfa None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.889987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.890622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.890901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.891172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.897909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.899398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:52.912458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:52.913531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:52.914599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:52.915746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 333/674] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:52.916624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:52.928855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf760-c6e8-4b78-84e5-b55307d5b69a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:52.949197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:52.966503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:52.967113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:52.967422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:52.967691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:52.968522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:52.968830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:52.970217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:52.985309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 342/675] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:52.986149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.026444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dba3a-46d7-4a07-82b0-fbc32f657196 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.040830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.066237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.066863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.067227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.067513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.068310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.068625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.070020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.083159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 334/676] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.084123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.113874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797da2e-334e-4118-a014-d7cb75bbcd3e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.148944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.149556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.149833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.150104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.150835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=b99f8096be0f41399f34257c8a1cd5ac) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.151142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.152645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.159309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 343/677] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:52 2022] GET /identity/v3/role_assignments?user.id=b99f8096be0f41399f34257c8a1cd5ac&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.160123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.199198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.214823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63290c5f-3ef8-42b7-b44b-6d2b1bd062d3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.260851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.261491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.261773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.262141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.262939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.263301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.265015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.278972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 335/678] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.279878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.290491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8452-c7ec-4a09-8267-fec3d40de598 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.294660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.344605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.345563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.346036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.346485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.354874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.356653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:53.368414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:53.369367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:53.370297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:53.372857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 344/679] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:53.374016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.406689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caef3-21ad-4097-8029-49804ed9c91d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.453189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.456242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.456545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.456826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.467134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.468737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:53.484967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:53.486098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 336/680] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:53.486986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.501316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a8b7-bc51-4fc3-a3ac-876c3d53fef3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.501606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.539932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.540457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.540736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.541005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.541741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=6c2ed0e5eabf49d2816ab27e21e54985) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.542046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.543533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640e8be-4756-4516-9719-6b1f92c652a5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 345/681] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/role_assignments?user.id=6c2ed0e5eabf49d2816ab27e21e54985&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b7c2-b842-4375-b782-3c70cdcbb773 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b7c2-b842-4375-b782-3c70cdcbb773 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166b7c2-b842-4375-b782-3c70cdcbb773 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 346/682] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:53.559231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b7c2-b842-4375-b782-3c70cdcbb773 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.594634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.630042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2399-2970-4ff6-9f21-d9597698926e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.680958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.681598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.681879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.682411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.683656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.684044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.685825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648363-0bf6-442b-a09f-54b8cf19e972 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.687758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166b7c2-b842-4375-b782-3c70cdcbb773 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.715743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 337/683] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.717647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.718010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.718620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.732717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.733487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.733831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.734166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.735308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:53.735630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:53.737358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:53.740468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:53.742141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:53.753323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 347/684] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:53.754575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.825497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.834155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 338/685] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:53.834846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:53.884377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:53.899201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f745385-fed7-42f0-8bfa-02ef665ad4c6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:53.943824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:53.944942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:53.945358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:53.945761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:53.946514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22659e6f-207a-4d0d-b2d5-27ae89496664 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.024327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.026278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.036458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.037091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.037371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.037645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.038390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=3509a6c850854eb7904672398e2d6cbb) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:54.038701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.040175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.061626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 339/686] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/role_assignments?user.id=3509a6c850854eb7904672398e2d6cbb&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:54.134514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:54.149688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 348/687] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:00:54.155590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.165933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.261037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:54.320793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7d0a7-8507-468f-823a-adf2b4b842cb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.330735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932b8c5-eb6e-465d-94e4-95dff74899cb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.367470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.368603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.369174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.369582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.371246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.372124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.372564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.372955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.382319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:54.386197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.387917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:54.388263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:54.389260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:54.390103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:54.393038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 349/688] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:54.399548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:54.413764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:54.414694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:54.416437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:54.416437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:54.416437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:54.417944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 340/689] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:54.424853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.477335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:54.546763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e8640-fb43-464e-bb99-f278840bc52f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.566630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae23ee-8db0-427b-b5e5-657c47e643ad None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.583472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:54.610291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.611245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.611733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.612691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.613990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:54.614894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.618563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.618836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.619644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.621515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.621960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.622823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:54.624410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.625936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.646384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 350/690] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:54.646843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 341/691] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:54.652074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.656414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.774939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb2a4-746a-408b-84be-94d39a94ec16 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.788960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:54.853035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.853688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.853968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.854240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.870415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a87a-2871-43cc-992c-26729cc022e6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:54.874745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.876248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:54.894918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:54.895873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:54.896853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:54.897290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 351/692] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:54.905996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:54.939653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2464457-d668-4a26-9478-033b279771ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:54.940364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464457-d668-4a26-9478-033b279771ee None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:54.940638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464457-d668-4a26-9478-033b279771ee None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:54.940954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464457-d668-4a26-9478-033b279771ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:54.959818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464457-d668-4a26-9478-033b279771ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:54.961625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464457-d668-4a26-9478-033b279771ee None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-a2464457-d668-4a26-9478-033b279771ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:54.992593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:54.993706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:54.994639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:54.994639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:54.994639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:54.994639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 342/693] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:55.004393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2464457-d668-4a26-9478-033b279771ee None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.056322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:55.088088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862cb5a-963e-4b2e-81f5-864318c5d3c8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.129227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.129844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.130120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.130388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.131085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:55.132600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.134037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.162495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 352/694] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:55.170021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.213230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:55.230757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2464457-d668-4a26-9478-033b279771ee None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.284513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.285199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.285482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.285751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.286405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:55.286706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.288234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2bd8f-70b1-4aa8-bdcf-b6cf3262d331 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.301679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 343/695] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:55.303110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc336dc-b811-43ac-8bb1-3c866d353450 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.303424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc336dc-b811-43ac-8bb1-3c866d353450 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.303699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc336dc-b811-43ac-8bb1-3c866d353450 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.309506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 344/696] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:55.310320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc336dc-b811-43ac-8bb1-3c866d353450 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14731-59e2-4625-85a7-13662e4fce4b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.359929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.360897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.361240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.361581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.362601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=79dc27d463f446a3a8da3aff55b6603e) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:55.363367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.365063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e51631-c01e-4d03-8020-0808783cffa5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.373557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 353/697] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/role_assignments?user.id=79dc27d463f446a3a8da3aff55b6603e&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:55.374888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.375173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.375468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.396785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:55.398014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:55.444350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:55.475266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc336dc-b811-43ac-8bb1-3c866d353450 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.479281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 354/698] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:55.517754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.518409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.518690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.518966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.527589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.529429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:55.542524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:55.543575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:55.544489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 345/699] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:55.552509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.600249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:55.677739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86ad3-8ebb-46fd-80ef-b18f61aaa4d7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.713264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.713804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.714084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.714356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.715157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:55.715495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.716941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.735106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 355/700] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:55.740499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.845666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:55.852054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14784d8-7076-4bac-99e5-8ab3af9f8db8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:55.888929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:55.889540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:55.889884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:55.890240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:55.910731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:55.969065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:55.970601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf694a61-7830-463c-82c0-fe88dc3ed79a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:55.974921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.003500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a333d-1432-4ec7-bead-c23838a79c92 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.045765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.046429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.046674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.046946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.047562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.049017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a6ed84a4-40bf-48ec-aa96-6ca15f3b4e93 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:56.060176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:56.061220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:56.062664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 356/701] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:56.063885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a515-e4eb-49a0-b482-0f3d43c285d8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.063885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a515-e4eb-49a0-b482-0f3d43c285d8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.063885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a515-e4eb-49a0-b482-0f3d43c285d8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.064774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 357/702] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:56.066957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a515-e4eb-49a0-b482-0f3d43c285d8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.105935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 346/703] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 13:00:56.107315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.107590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.107898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.129533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:56.131399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:56.179976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.182018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a515-e4eb-49a0-b482-0f3d43c285d8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.212528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 347/704] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:56.213612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.237932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.238470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.238741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.239052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.239718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:56.240016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.241525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.253807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 358/705] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:56.259486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.285302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.328396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b17e44-6b61-42be-821a-eb64b479cb41 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.367412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.368069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.368323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.368590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.379168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.380744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:56.395849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:56.396795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:56.397664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:56.397664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:56.397664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:56.397664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 348/706] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:56.404354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.457651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.482292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c42ab9-ca5e-495d-b54e-921768e852c2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.527791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.529030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.529352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.529809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.530758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:56.531072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.532497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cc67e-ea11-49a7-91c4-8acf9b6c2874 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.542011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 359/707] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:56.543714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbae3-47e9-46a6-8dcf-db7d6540e1ed None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.544213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbae3-47e9-46a6-8dcf-db7d6540e1ed None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.544510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbae3-47e9-46a6-8dcf-db7d6540e1ed None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.546511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bc7d-1bd5-4d1f-a136-ce7091cecb84 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.550544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 360/708] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:56.553139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.553431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.553716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.574461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:56.576124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:56.596896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.597537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.597820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.598098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.598778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:56.599089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.600549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.628153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 349/709] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:56.628153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.669405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 361/710] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:56.675273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.677757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.768995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:56.784447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9b33-4c40-472f-b44d-10e2b22e5184 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.832422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5f96-a4a7-45f0-805f-076a488906c7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:56.835546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.836363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.836782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.837187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.860128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.861942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:56.885188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:56.886390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:56.887637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:56.887637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:56.887637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:56.889424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 350/711] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:56.896464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:56.917512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:56.918792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:56.919345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:56.919826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:56.932804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:56.935719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:00:56.957970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:56.958910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:00:56.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:56.961280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 362/712] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:56.967408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.071831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8315-06d2-4432-abdf-039b493f1743 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.110970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.112054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.112162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:57.112623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.113081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.113938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:57.114440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.116053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.126864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:57.135176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 351/713] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:57.136226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.164060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec39f3-261c-41c0-8153-26c83447a626 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.211838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.212462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.212740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.213008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.213710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:57.214018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.215899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.231584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 363/714] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:57.232254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.251740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4925-141e-4f3b-887b-535256bc42c5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.299287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.300469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.300928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.301397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] PATH_INFO: `/v3/services/network` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.302160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.304654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:57.322207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:57.323427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:00:57.324331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:57.325914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 352/715] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:00:57 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:57.326595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.343229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02380-cb31-48dd-9d5f-412e25294eef None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.368443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:57.381046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.381662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.381938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.382205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.382860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.384496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.415321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:57.416480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 364/716] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:00:57 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:00:57.418541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.504808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfda7-4afa-441a-a37d-2b12333b304d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.551127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a41da-d8a1-4235-8002-2fe1f9a6e14a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.593670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.594118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.594236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.594510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.594784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.595475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.595613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:57.595860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.596301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.597384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f169-f4bc-41e7-8018-1a2554f9bf93 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.598100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.598927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] RBAC: Adding query filter params (name=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:57.599531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.601192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.607112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 365/717] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:00:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:57.614750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:57.617800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 353/718] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:00:57 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:57.677685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:57.734471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c0a9-05d2-4ae0-9af0-c251c09d7b04 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:57.773534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:57.774180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.774464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.774740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.775448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] RBAC: Adding query filter params (type=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:57.775751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:57.777305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620153-3bbc-4c6a-851f-af8f07013d40 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:57.783830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 366/719] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:00:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:00:57.963547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3b2a-e5b0-48b6-840a-bd8c68a91bed None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.964073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3b2a-e5b0-48b6-840a-bd8c68a91bed None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.964073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d3b2a-e5b0-48b6-840a-bd8c68a91bed None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.965692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 354/720] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:57.971467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:57.971971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:57.972060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:57.991040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:57.992459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:58.067745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 367/721] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:58.459206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d3b2a-e5b0-48b6-840a-bd8c68a91bed None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:58.600915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d3b2a-e5b0-48b6-840a-bd8c68a91bed None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:58.639796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:58.652966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:58.653962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:58.654243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:58.654515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:58.672886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-2648f78a-b4e7-4a4b-8920-90f7205e616c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:00:58.677626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:58.678515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:00:58.679345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 355/722] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:58.686416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:58.739562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:58.778001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b30ac-0e8b-4f4f-8f9c-51b3eeda4cbd None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:58.778649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b30ac-0e8b-4f4f-8f9c-51b3eeda4cbd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:58.778874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b30ac-0e8b-4f4f-8f9c-51b3eeda4cbd None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:58.784626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 356/723] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:00:58.789932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:58.790213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:58.790487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:58.815789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e40339-b423-4e32-b13a-148c03430667 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:58.831043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:58.832279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:00:58.868858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:58.869508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:58.869781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:58.870054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:58.870757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:58.871061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:58.872561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:58.887720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 368/724] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:58.892406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:58.953445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 357/725] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:00:58.994484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:58.997838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8354e9-e063-4f7b-bc09-5286bcf09681 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.034522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.035164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.035465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.035736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.047114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:59.048625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:00:59.065169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:59.066235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:00:59.067121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:00:59.067121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:00:59.067121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:59.067121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 369/726] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:00:59.073770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:59.200005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c46f9-0a76-4797-84c6-f925779314c8 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.218687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:59.246868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.247442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.247732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.248000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.248669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:59.248974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:59.250439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:59.263494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 358/727] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:59.269028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:59.322466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:59.399354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be1c9f-b3cd-4c11-a390-fc0e4d6173ff None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.436917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.437556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.437832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.438101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.446790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:59.448472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:00:59.460686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:00:59.461673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:00:59.462581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 370/728] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:00:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:00:59.469614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:59.501004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:59.557545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543d85b-812d-41be-8069-5c43060a827a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.631122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603fa74-f632-45a1-9ede-35e4d692ecc3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.645496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.646554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.647027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.647521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.649768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:59.652362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:59.690332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 359/729] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:00:59 2022] POST /identity/v3/services => generated 251 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:00:59.718041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.719091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.719601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.720037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.721003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:00:59.721454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:00:59.723062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aac2-26af-4b30-9c3a-365d4dfe5413 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:00:59.750132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 371/730] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:00:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:00:59.756405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:00:59.803533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:00:59.868892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec2ed-cf13-45f9-838f-4d0b0c4d9bfd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.869420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec2ed-cf13-45f9-838f-4d0b0c4d9bfd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.869829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec2ed-cf13-45f9-838f-4d0b0c4d9bfd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.871458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 372/731] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:00:59.877530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f346-cd17-4d78-a92b-ceaf05702911 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.877530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f346-cd17-4d78-a92b-ceaf05702911 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.877830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f346-cd17-4d78-a92b-ceaf05702911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.881099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd20-5675-47ff-9e27-c3eaf7d2e588 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:00:59.920820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:00:59.921747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:00:59.922167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:00:59.922581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:00:59.924267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d755f346-cd17-4d78-a92b-ceaf05702911 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:00:59.925495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d755f346-cd17-4d78-a92b-ceaf05702911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:00.000539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:00.002378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:00.048726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.052903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.062899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 373/732] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:00:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:01:00.064254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e97c6-8442-44ea-8554-c9d6ee7475d9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.064535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e97c6-8442-44ea-8554-c9d6ee7475d9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.064805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e97c6-8442-44ea-8554-c9d6ee7475d9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.066256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 374/733] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:00.072116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2439fc7-6583-4b6b-ad52-75bfc33b31f4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.072116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2439fc7-6583-4b6b-ad52-75bfc33b31f4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.072389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2439fc7-6583-4b6b-ad52-75bfc33b31f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.092756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f2439fc7-6583-4b6b-ad52-75bfc33b31f4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:00.093971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f2439fc7-6583-4b6b-ad52-75bfc33b31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:00.142512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 360/734] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:00:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 13:01:00.149386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.197134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 375/735] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 13:01:00.315118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1b59-a488-4198-aeed-e3940ca57ce5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.363016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.363769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.364045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.364377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.371763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c408-060f-48ba-9310-995c3f51d462 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.372373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c408-060f-48ba-9310-995c3f51d462 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.372846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313c408-060f-48ba-9310-995c3f51d462 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.374685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 376/736] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:00.379432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.385357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:00.386888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:00.392286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.392571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.392843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:00.404838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:00.405838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:00.406725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:00.406725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:00.406725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:00.407427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 361/737] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:00.408366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.422112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:00.423251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:00.501324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 377/738] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 13:01:00.502507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.537595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603480d9-dc71-4d26-ab0a-9806bf8feff8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.576132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.584091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.584753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.585036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.585312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.599607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:00.612353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:00.613524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:00.614638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 362/739] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:00.616062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.643706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8cc19-90ff-42ff-b754-32d737bffb00 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.683604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.712333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.713330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.713844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.714336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.715766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:00.716375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:00.718337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:00.751263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30300258-8d32-410e-b76c-bc700653cd22 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.751534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 378/740] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:00.751534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.792616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.793517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.793796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.794066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.806789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:00.812071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:00.813504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 363/741] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:00.815195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.878163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06505ca-e89a-47ee-a701-639ba767cb26 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.895530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.917333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.918517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.918801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.919055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.920031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:00.920331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:00.922424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:00.932492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 379/742] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:00.932709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7af87-4fb3-4a4a-ab6e-1ad78efdfc45 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:00.933297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:00.950283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:00.981513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:00.982177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:00.982455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:00.982723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:00.990931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:00.992475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:01.005213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:01.006175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:01.007064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 364/743] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:01.007996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.060322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa50a5e-644d-4e98-a1f8-22aa6eb0cfc4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.104688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.105307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.105618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.105889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.106543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.107992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.126402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 380/744] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:00 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:01.127287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.145945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6161-2c89-4107-a180-9fbcde61c1d7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.173274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.202262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.203418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.204052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.204632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.205598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:01.206084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.207859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.218577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 365/745] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:01.219983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.250141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7fe62-5a02-4aa7-a432-cece47059673 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.253638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.290334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.290999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.291513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.291621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.303555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.304700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:01.321357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:01.322515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:01.323656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:01.323656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:01.323656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:01.324031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 381/746] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:01.325521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.345130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93082b53-9376-4979-93ae-f639a9e9a67c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.388629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.389261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.389797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.390070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.391018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:01.391368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.393549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.408454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 366/747] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:01.409239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.436818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.448696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d25c1-f2a4-4be5-aea2-8bf9ca3e6cd5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.484548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.485443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.485861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.486268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.499003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.500962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.514492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:01.518344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:01.520297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:01.521448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:01.521448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:01.521448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:01.521448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 382/748] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:01.521448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.533770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f77d-b890-4ee3-8018-7c7bdfd16dde None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.586299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.586920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.587463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.587736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.588391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:01.588692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.590109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.602342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 367/749] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:01.603620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.654024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125e93d-5230-40d9-ac1d-b5ebe35a7bfb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.705949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.707042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.707923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.708585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.709622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=79dc27d463f446a3a8da3aff55b6603e) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:01.710283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.712234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.720183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 383/750] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/role_assignments?user.id=79dc27d463f446a3a8da3aff55b6603e&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:01.721339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.732528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.742121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e178e-6619-4538-a932-2733b7843510 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.848735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.849522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.849882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.850252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.850974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:01.851344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0129-5b6f-4d90-a24f-05cee32fbca3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:01.851454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.852864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.886882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 368/751] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:01.892132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:01.893759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:01.894626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:01.895080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:01.895541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:01.906505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:01.909009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:01.919575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:01.924835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:01.925799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:01.926774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:01.930144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 384/752] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:01.935773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.021435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.041237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b80b-0c85-4acd-9380-5cf625bc04ca None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.064881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3d757-a69c-4cfe-8554-c0098f69e55b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.089578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.090832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.091753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.092353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.102585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.103100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.103612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.103985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.104349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.105183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:02.105644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.105838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.107368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d200-d314-4db1-95df-aa4e08e3c5cd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-9762f9c3-2a42-455c-afc7-54a0a2f32b38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:02.121314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:02.122410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:02.123513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 369/753] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:02.125428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ba4f-4eeb-482e-aa3e-cf8c4566c75f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.125797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ba4f-4eeb-482e-aa3e-cf8c4566c75f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.126156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471ba4f-4eeb-482e-aa3e-cf8c4566c75f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.127907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 370/754] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:02.128703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ba4f-4eeb-482e-aa3e-cf8c4566c75f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.132416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 385/755] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:01:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:02.134829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.135305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.135719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.160276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:02.162159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:02.203136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.242156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471ba4f-4eeb-482e-aa3e-cf8c4566c75f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.255433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 386/756] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:02.257273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.278841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.279406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.279690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.279951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.280692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:02.280997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.282660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.301334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 371/757] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:02.307109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.327037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.377836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474a1c9-5589-46b4-8f3d-81ca38154d89 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.418194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.419291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.419810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.420283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.432507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.434435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:02.451455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:02.452539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:02.453431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:02.453431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:02.453431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:02.455702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 387/758] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:02.464499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.491575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8bc78-834a-468d-826f-2cf66101469c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.519640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.537560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.538096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.538371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.538632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.653042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807a188-5d2a-4995-b066-0b239fb8d42f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.657967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.659558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.661258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.691167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.691954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.692530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.692807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.693713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:02.694013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.695563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.711043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 388/759] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:02.712357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.767291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 372/760] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 13:01:02.768447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.819729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.819919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbc42d-76ae-4509-964e-2f2ab3ebed1e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.855059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.855858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.856134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.856400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.856985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.858365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:02.867478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:02.868480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:02.870549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 389/761] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:02.872472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.881158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d34f-7a07-4d5a-88c5-699009a4e930 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:02.902109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:02.921083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:02.921736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:02.922114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:02.922390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:02.931305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:02.933548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:02.949300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:02.951538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 373/762] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:02.953758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:02.987887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77990-487b-4de2-b5f0-c7ce7080477e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.041898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.043518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.044055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.044533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.057624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.059598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.067149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:03.078636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:03.080126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:03.081132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:03.081132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:03.081132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:03.082978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 390/763] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:03.084043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.089424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4dd28-54b5-4849-b5a0-65fa92a46e05 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.134746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.135678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.136888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.137159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.138011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.138313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.141276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.152440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 374/764] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:01:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:03.152440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.188285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.213613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372d716-ebdc-41c4-bdb6-649667bb7fb7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.251579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.252197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.252477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.252743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.253437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.253739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.255174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.268142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 391/765] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:03.268954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.280021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19a03-c266-4372-862d-7ce7ef74f619 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.318126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.318932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.319231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.319507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.320162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.320466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.322037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54248003-e252-43b3-b147-0a6a94f5608c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.339594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 375/766] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:03.341014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485228-df45-45ac-869b-2df07215388d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.341292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485228-df45-45ac-869b-2df07215388d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.341587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485228-df45-45ac-869b-2df07215388d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.343476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 376/767] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:03.343678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485228-df45-45ac-869b-2df07215388d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.359811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.398001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b0e8a-d752-4627-9db2-1e6fc741c621 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.434551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.435372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.435636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.435964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.436662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.437020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.438674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.444632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 392/768] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:03.445497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.455821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.476421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485228-df45-45ac-869b-2df07215388d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.515438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.516442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.516883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.517163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.519147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=acc4c0a07dfa4d738ce279cafb5fd3e0, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.520639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d933-2334-4f0b-a002-fe7ba6d9b4c3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.547222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 377/769] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:03 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:01:03.547222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061617a3-b097-4372-8774-08d6eb369682 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.547222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061617a3-b097-4372-8774-08d6eb369682 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.547222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061617a3-b097-4372-8774-08d6eb369682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.561975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-061617a3-b097-4372-8774-08d6eb369682 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:03.563333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-061617a3-b097-4372-8774-08d6eb369682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:03.585785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f410fc-8787-43c7-adcc-5c6469913e5d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.638794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.639765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.640935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.641409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.652645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.654474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.656913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.667373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 378/770] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:03.668743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061617a3-b097-4372-8774-08d6eb369682 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:03.673611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:03.674545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:03.675464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:03.679129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 393/771] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:03.685464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.770254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:03.813524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed5a7-2582-467f-881d-2eff1c352f60 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.858557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.859331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.859612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.859947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.861286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.861599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.863654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.882351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 394/772] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:03.892163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:03.925001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061617a3-b097-4372-8774-08d6eb369682 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:03.965883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:03.966600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.966880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.967151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.967972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] RBAC: Adding query filter params (interface=public, service_id=b2c85d5184fe4eea92bc2c380bc02a76, region_id=RegionOne) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:03.968664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:03.969880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62822e7c-f352-496e-8404-b34bb3e51ea5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:03.979957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 379/773] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/endpoints?service_id=b2c85d5184fe4eea92bc2c380bc02a76&interface=public®ion_id=RegionOne => generated 194 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:03.981240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3477-8b6f-422e-9208-f1dfe213d0e2 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:03.981522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3477-8b6f-422e-9208-f1dfe213d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:03.981882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3477-8b6f-422e-9208-f1dfe213d0e2 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:03.983474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 380/774] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:03.988612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3477-8b6f-422e-9208-f1dfe213d0e2 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.007122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ded5a-c32d-4bed-bedb-a1165b3052e6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.053466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:04.066044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.066852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.067252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.067670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.068697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f4977f2d1c1c46b7995f02caeb81cc8f) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:04.071234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:04.071234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc1ba2-bb48-4518-bf1b-d2d945eeec19 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:04.072620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:04.087107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 395/775] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/role_assignments?user.id=f4977f2d1c1c46b7995f02caeb81cc8f&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:04.087107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.087107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.087107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.112182 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:04.114086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:04.140246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3477-8b6f-422e-9208-f1dfe213d0e2 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.183781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.184576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.185051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.185427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.186252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:04.187901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:04.194768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 381/776] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:03 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:04.203340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.225313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 396/777] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:04.344271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d022b-589e-4d63-9411-fca903a11e2c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.375120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:04.390112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.390816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.391154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.391456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] PATH_INFO: `/v3/services/network` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.392053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:04.393450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:04.403717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:04.404717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:04.405537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 382/778] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:04.411087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.524908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6348b3-43c4-451c-979c-025f0d73290b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.548377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:04.565273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.565892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.566167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.566436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.567077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] RBAC: Adding query filter params (name=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:04.567399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:04.568834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:04.578348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 397/779] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:04.580479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.587006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.697543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d621a4-bbb4-43c7-a91a-6b94da18a46d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.734196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.734978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.735275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.735543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.747003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:04.752006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:04.754186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:04.756152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:04.757624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb31b-1a21-4433-bbfd-a8f2a3433274 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:04.763245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 398/780] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:04.763245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.822808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:04.823768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:04.824244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:04.824676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:04.827490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] RBAC: Adding query filter params (type=network) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:04.828049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:04.829710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:04.837230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 383/781] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:04.844237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:04.886350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:04.936012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:05.003954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2902-4840-4643-bbb4-6dd87101fbfa None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.014361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e6fc-5c29-46f4-95fc-8d960b298d41 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.060019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.061056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.063729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.064235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.065179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] RBAC: Adding query filter params (interface=public, service_id=6b579a6171f34a2387d7239422333df3, region_id=RegionOne) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:05.065690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.067317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.082868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 384/782] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/endpoints?service_id=6b579a6171f34a2387d7239422333df3&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:05.089940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:05.101884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.102564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.102839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.103109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.103812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:05.104108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.107520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.125836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 399/783] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:05.140708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:05.218789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844fa76-05e1-401a-98fc-3447cee5d282 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.240903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:05.263707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.264244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.264624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.264897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.265512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.266907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.284681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 385/784] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:05 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:05.366533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120fe1a-5d96-4e14-b7cb-c6f0793f7936 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.378763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:05.422173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.422831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.423106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.423404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.441615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.443106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:05.461925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:05.462932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:05.463869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:05.463869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:05.463869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:05.463869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 400/785] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:05.469664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:05.604915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e5b3-6fb9-4119-94dd-341488cdcd09 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.652314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.652959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.653571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.653841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.654572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:05.654873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.656304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259bc99-2079-4730-9e82-a501a0e0cda2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.674079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 386/786] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:05.680229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:05.817692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa4342-87bf-4784-8471-1d83c14867fb None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:05.819875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92268-3a75-45e6-91a7-12eed93968f2 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.820164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92268-3a75-45e6-91a7-12eed93968f2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.820436 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92268-3a75-45e6-91a7-12eed93968f2 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.822057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 387/787] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:05.827850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.828138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.828401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.847150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:05.848462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:05.872061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:05.872617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:05.872894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:05.873158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:05.888402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:05.889860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:05.917552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:05.918619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:05.919574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 401/788] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:05.921982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:05.928007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:05.962114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 388/789] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:05.964783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:06.075674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26cb9-3803-4b2c-8101-685e5aa208f1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.124059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.124820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.124978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.125123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.125885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:06.126189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:06.127760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:06.149164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 402/790] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:01:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:06.155175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.294702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc54475-7d88-46b5-a39a-40d3c6a18905 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.338845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.339556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.339903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.340175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.342869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.372553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:06.375804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:06.406004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:06.408263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:06.410338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:06.410338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:06.410338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:06.410338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 389/791] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:06.415687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.470916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:06.499124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:06.545888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac4e0-4d10-443f-af21-9c26e84acbd4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.597889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.598527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.598799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.599069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.614486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:06.625665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:06.626802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:06.628531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 403/792] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:06.636459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.649532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61b06-0389-44c9-a3b7-f8613dc92221 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.712725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.713543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.713836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.714118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.714939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:06.715281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:06.716907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:06.734871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 390/793] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:06.736976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.835169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0341c-b972-40dc-a49b-13e544d1a69e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.839662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:06.854469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeaba0-447c-4dcb-bd33-1e5ec2ec7276 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:06.871992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.872707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.872984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.873253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.873935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:06.874235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:06.875670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1fe4f-a29f-4a07-8521-1085bd30292c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:06.878392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:06.890701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 404/794] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:06.893499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115280a1-d9ec-46e0-aacf-f4b401e1a66c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.894504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115280a1-d9ec-46e0-aacf-f4b401e1a66c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.894774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115280a1-d9ec-46e0-aacf-f4b401e1a66c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.896126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 405/795] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:06.896823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115280a1-d9ec-46e0-aacf-f4b401e1a66c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:06.905207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:06.905917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.906205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.906513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.917626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:06.919692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-7f675fbe-f8a3-424f-a18d-2c92a74ca048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:06.939221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:06.940190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 391/796] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:06.941663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e15e-bd45-4557-9239-d5aa94d7f162 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.943153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e15e-bd45-4557-9239-d5aa94d7f162 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.943153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e15e-bd45-4557-9239-d5aa94d7f162 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.944364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 392/797] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:06.948510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:06.948779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:06.950039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:06.970932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:06.972370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:07.036391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115280a1-d9ec-46e0-aacf-f4b401e1a66c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.063344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 393/798] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:07.064272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.079316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.080788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.081567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.082208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.109770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.112419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b92427e6-919b-4aa5-9de8-deda84f2e829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:07.138120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:07.139895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:07.141175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:07.141175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:07.141175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:07.147669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 406/799] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:07.149050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.149324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.149593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.168784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:07.169986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:07.170571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.203219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549252-d26e-4fbd-bd84-b8a0456c6719 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.227700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.247457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.248089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.248367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.248633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.249335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:07.249638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.251146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.260941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 407/800] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:07.261845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.274581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 394/801] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:07.277186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.405733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8bf3e-5c63-4159-8212-2774ba5445e2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.422571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a4bfa-56a2-40e6-81ae-e34b3d4a2b5e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.468379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.469066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.469343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.469614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/79dc27d463f446a3a8da3aff55b6603e/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.472030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=79dc27d463f446a3a8da3aff55b6603e, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.472767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.473498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.473832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.474305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.474764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.475661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:07.476375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.477104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.478794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.497236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 395/802] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:07 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/79dc27d463f446a3a8da3aff55b6603e/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:01:07.497236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.497835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 408/803] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:07.504599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.584327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.656268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922919-b82f-42fb-b7f9-f080af30c16e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.658807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f79d-567b-495d-a18a-2d9e18177265 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.701461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.702171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.702488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.702758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.706082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.707101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.707564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.708119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.716030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:07.721092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:07.721337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:07.723122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 396/804] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:07.724789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.729303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a42b4895-606a-4ec4-95f9-eba65e550848 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:07.752689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:07.754196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:07.755441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:07.756590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 409/805] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:07.760637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1d6d-9320-4b7f-9fd6-9225749f8f61 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.760921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1d6d-9320-4b7f-9fd6-9225749f8f61 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.761196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1d6d-9320-4b7f-9fd6-9225749f8f61 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.762849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 410/806] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:07.766845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1d6d-9320-4b7f-9fd6-9225749f8f61 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.803677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.878731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260850c8-68be-4ac2-b2a1-b2ec4ae8a6d5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.887912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:07.893054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1d6d-9320-4b7f-9fd6-9225749f8f61 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:07.930051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.930712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.931001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.931312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.932046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.934764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.934879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:07.935523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.935805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.936069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.936740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:07.937041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:07.940811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ed526df2-b74d-46bf-9a81-eb52514d9082 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:07.947854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:07.948962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 13:01:07.950434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:07.951160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 411/807] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:07.951160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:07.951968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 397/808] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:07.953272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:07.953550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:07.953825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:07.979479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:07.981524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:08.067220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 398/809] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:08.067220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.077462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1cb6f-fb54-4898-a2c9-e411dc3a4fe0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.116003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.126675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.127761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.128045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.128312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.129325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:08.129626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.131907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.157239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 412/810] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:01:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:08.158199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.181214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56186-c523-460a-9a2c-c2820bfb43bc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.191818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.232884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.234224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.234647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.235118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.236057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:08.236522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.238207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.250792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 399/811] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:08.252813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.312111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289be7-637c-44c8-ac12-41dc50dceba7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.364083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.364810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.365040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.365249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.376176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff7f2d-1d60-47d1-a4bb-402252bb1e6c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.376618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.377999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.395033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:08.396107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:08.397017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:08.397900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:08.397900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:08.397900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:08.397900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 413/812] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:08.398136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.423971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.424599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.424869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.425142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.499932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.505966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.507578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.535555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94d83-6d56-4ef3-aee6-f63e07732ecf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.572970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.573588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.573863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.574177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.574815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:08.575165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.576606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.582223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 414/813] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:08.583633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.631736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 400/814] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:08.632702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.649047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.734690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c387-638a-49f8-98e1-6c8c96e9d0f8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.740657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b30e8-fc06-4938-baad-947edc74c429 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.777370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.778393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.778670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.778768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.778948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.779404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.779574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.779664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.779932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.780569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:08.780863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.780952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.782224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.783945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:08.791409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:08.792441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 13:01:08.793311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:08.800848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 401/815] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:08.800848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.803783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 415/816] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:08.804630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:08.901413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:08.919802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53884-4dab-4bae-8ad6-b309d5c82fa7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.937667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5dec8-4fbc-4179-8d99-daaf98f9f94f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:08.963094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.964360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.965019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.965511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.978720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:08.979364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:08.979625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:08.979906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:08.980502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.980746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:08.982132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.982248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:08.998778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:09.000535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:09.002782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:09.002782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:09.002782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:09.002782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 416/817] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:09.002782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.016208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 402/818] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:09.017188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.116124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.161978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769ce9-2235-4f39-9532-60e1ab005647 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.162651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11283e-24b8-4ea3-9bdb-7feb2d1464aa None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.196046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.215633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.216331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.216568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.216837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.223118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.224715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.224715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.224715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.225104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] RBAC: Adding query filter params (name=network) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:09.225431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.227058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.228337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.229866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.237313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 417/819] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:09.238516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:09.253659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:09.255337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 403/820] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:09.257185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.380438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a5b2-51bf-4d3b-9ff4-e1736209a632 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.391349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf10dc-ae6e-49fa-ac66-3564caddec20 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.401993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.426599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.427531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.427967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.428374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.429638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:09.430364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.432090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1663ec-4897-4c77-89de-57ecd3d17890 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.437865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.438483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.438757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.439022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.439699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:09.440001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.441476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.447796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 404/821] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:09.448644 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.449572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 418/822] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:09.451143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b921-a576-4d4e-9253-70d1346e0afc None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.451603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b921-a576-4d4e-9253-70d1346e0afc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.452024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4b921-a576-4d4e-9253-70d1346e0afc None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.454067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 419/823] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:09.454994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4b921-a576-4d4e-9253-70d1346e0afc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.516322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.571527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d4be-940d-443b-b326-f36856971ec4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.595756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4b921-a576-4d4e-9253-70d1346e0afc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.619964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.620677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.620995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.621268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.622018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:09.622322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.623869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.637204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.637768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.638027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.638301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.639476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.640880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887285dc-6aee-4dea-9513-71b64223bb02 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.650571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 405/824] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:09.650571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.676997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 420/825] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:09.679161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.679668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.680246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.705478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:09.707619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:09.746127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.775640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621a87-644b-4cbf-95a3-98e4223a25aa None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:09.789542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:09.819470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 421/826] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:09.820285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:09.820959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:09.821312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:09.821718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:09.822053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:09.832263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:09.833903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:09.848223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:09.850005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:09.851839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:09.852723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 406/827] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:09.858352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.012958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8517e-757a-4101-9d96-a431d2e2f2e0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.087372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.088177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.088554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.088922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.089801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:10.090208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.092774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.108983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 407/828] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:10.115463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.119396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbd5fb-e0f3-4547-ae62-4296637f32cd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.163496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.164872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.165295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.165946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.169003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.184283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.185770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:10.205626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:10.206802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:10.207903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:10.207903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:10.207903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:10.207903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 422/829] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:10.208605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.227350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.268890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40430-543a-4f31-8ddd-666d72b19965 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.306313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.306939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.307243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.307527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.308287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:10.308633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.310118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.319764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 408/830] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:10.321377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.334622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d75-d8b2-4918-a630-68213131a287 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.379640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.380861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.381336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.381669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.397177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:10.402197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:10.403573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:10.410648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 423/831] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:10.411644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.475070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.486930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5589c3-3887-4710-bfa0-9dd7b3400987 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.496891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.538540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4b2df-3e9f-4f5b-bd1b-4fdbdef63692 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.538848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.539487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.539763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.541363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.542977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:10.542977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.553403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.562992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 409/832] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:10.568739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.588427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.589410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.589931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.590418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.591333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:10.591829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.593417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.603240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 424/833] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:10.610978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.726598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e17-1687-4582-878b-92df819d96f9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.757610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.763864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.764734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.765182 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.765607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.767439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e28e6-75d0-4af0-b983-2af5ce2a8b49 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.778853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.780803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:10.795968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:10.796900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:10.797762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:10.797762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:10.797762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:10.799920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 425/834] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:10.808724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.819277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:10.819958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:10.820232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:10.820499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:10.829817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:10.831438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:10.844560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:10.845524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:10.846427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:10.850643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 410/835] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:10.852158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:10.869972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:10.962094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff19c0-3872-4dc9-952a-345b96e4e5fa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:10.984607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd7be-13af-40d0-8df3-cacb85c95983 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.011886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.013019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.013300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.013568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.014272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:11.014641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.016477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.026423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.027518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.028429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.029112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.030481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:11.031276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.037196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 426/836] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:11.041175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.044717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.066293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 411/837] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:11.068754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.121839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.160848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.195122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafc6a1-cef5-41db-896e-7491da0da637 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.196588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f136-60b7-478d-91db-abbd189401db None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.234458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.235087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.235385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.235652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.236539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.237207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.237737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.238071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f4977f2d1c1c46b7995f02caeb81cc8f/roles/38517e3148874268801b6c81529aa789` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.243959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.244755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-cd0c8bd1-ab54-4eae-bed3-d0221bc8ae5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:11.257428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:11.258738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 427/838] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd16fe-04a6-433f-ac8e-28233a2fdcc1 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.260690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd16fe-04a6-433f-ac8e-28233a2fdcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.262181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd16fe-04a6-433f-ac8e-28233a2fdcc1 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.262181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 428/839] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:11.264955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=f4977f2d1c1c46b7995f02caeb81cc8f, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.266463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8b2c-87a8-40bf-9ee2-f2c56958efa0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.266662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd16fe-04a6-433f-ac8e-28233a2fdcc1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.287279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 412/840] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:11 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f4977f2d1c1c46b7995f02caeb81cc8f/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:01:11.287495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.287717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.287991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.319080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:11.322114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:11.418598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd16fe-04a6-433f-ac8e-28233a2fdcc1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.421746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.464071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.465074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.465497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.465910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.466878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:11.467391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.469023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.490837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 429/841] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 13:01:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:11.499372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.554388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 413/842] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:11.634419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959acc-2854-4b75-a641-64fb46c60b3b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.679308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:11.679932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:11.680209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:11.680479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:11.713906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.754988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:11.756487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:11.816450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.873049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 430/843] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 13:01:11.874375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:11.894126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.943745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:11.974923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c1472-4977-4cd0-8593-1a1e9c95bdb7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:11.997418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f53b47-3829-4156-a3d2-b710a0f3ef08 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.022275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.023207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.023511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.023782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.024373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.026072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.037981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:12.038818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:12.039796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:12.040596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 414/844] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:12.046946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.046946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.046946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.049092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.061057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.063037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:12.082780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:12.083818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:12.084683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:12.084683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:12.084683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:12.087278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 431/845] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:12.090028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.189419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d75b-2e2a-49e6-8b5c-29f0a7af1bea None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.214296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943673e-b80a-481d-8194-b8086e9ede50 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.220753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:12.233860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:12.244565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.245884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.246372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.246839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.247909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:12.248724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.250592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.257398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 415/846] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:12.263938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.265914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.266612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.266953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.267336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.268165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:12.268539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.270059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.288762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 432/847] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:12.289901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.403926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e39fe-dc86-46eb-94ab-bde40228790c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.425050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fe1b-09a7-4afe-ba15-37ea5f65615f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.453109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.454350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.454770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.455069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.455792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:12.456094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.457604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a65e4-17cb-442a-a2f5-9a06837a73f2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.464066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 416/848] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:12.466228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9f3d-56c4-42cc-8e4c-4bcca8b147e6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.466499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9f3d-56c4-42cc-8e4c-4bcca8b147e6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.466773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f9f3d-56c4-42cc-8e4c-4bcca8b147e6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.468499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 417/849] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:12.474984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.475402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.475717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.490706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.492105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.492584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.493033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.496186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:12.498076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:12.504807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.506809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:12.524139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:12.525103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:12.525952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:12.529057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 433/850] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:12.534948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.554976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:12.584143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:12.595435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 418/851] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:12.676372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9919a1-ac53-41ef-848d-26c4353d52f8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.716323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079048-3617-4e68-a098-efbe05694277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.716918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079048-3617-4e68-a098-efbe05694277 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.717197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079048-3617-4e68-a098-efbe05694277 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.717465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079048-3617-4e68-a098-efbe05694277 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.718167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77079048-3617-4e68-a098-efbe05694277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:12.718467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77079048-3617-4e68-a098-efbe05694277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.719936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77079048-3617-4e68-a098-efbe05694277 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.733778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 434/852] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:12.739726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:12.850701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f3c8e-a136-4ba4-ab88-07984e4bb924 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:12.888856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:12.889891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:12.890396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:12.890863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:12.891835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=79dc27d463f446a3a8da3aff55b6603e) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:12.892346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:12.894161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:12.902213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 419/853] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/role_assignments?user.id=79dc27d463f446a3a8da3aff55b6603e&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:12.929240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079048-3617-4e68-a098-efbe05694277 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:13.059652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:13.065672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079048-3617-4e68-a098-efbe05694277 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:13.114060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:13.114710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.114987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.115294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.115894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:13.117297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:13.127463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:13.128444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:13.129312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 435/854] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 13:01:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:13.134631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:13.199564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:13.257295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce560-2c37-4d14-a266-d1c248cd3cdc None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:13.293543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:13.294480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.294961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.295437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.296244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:13.296718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:13.298278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb87be9-fef6-460b-a76d-27cdbac782e9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:13.303986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 420/855] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:13.312770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:13.382559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f842d-b3da-4199-8bac-03ba0f66fb3b None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.383006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f842d-b3da-4199-8bac-03ba0f66fb3b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.384241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f842d-b3da-4199-8bac-03ba0f66fb3b None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.388109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 421/856] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:13.398371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.398760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.398912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.423637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:13.424879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:13.456432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b89b2-bf17-475a-ad5a-b22585df7f46 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:13.493001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:13.493625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.493905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.494178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.494824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:13.495134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:13.496594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:13.506505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 436/857] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:13.509837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 422/858] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:13.780141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:13.805636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:13.903952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1db89e-7640-45db-b446-a420ab4802b2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:13.940952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:13.941593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:13.941869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:13.942138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:13.953931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:13.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:13.961269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:13.963124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 437/859] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:13.967820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.012427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:14.074379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8da757-3421-4e6d-a163-c5d52701ea31 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:14.111041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:14.111754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.112032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.112297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.113022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:14.113325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:14.114772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:14.124368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 423/860] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:14.130054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.222667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:14.242534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f67e6-93bf-4221-b9f6-ab2136ee7f98 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:14.283087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:14.283925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.284203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.284477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.297504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:14.298992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:14.314102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:14.315848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:14.317013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:14.317013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:14.317013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:14.317013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 438/861] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:14.321344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.419591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:14.426596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adba29-ba89-48db-8a76-ebe8a11bc164 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:14.463375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:14.464009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.464284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.464653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.465315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:14.465618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:14.467034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058e083-6088-4b85-a356-d17870bc3a8e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:14.480791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 424/862] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:14.486347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.524046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55f68-b61d-429f-81e2-23627a09baf6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.524370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55f68-b61d-429f-81e2-23627a09baf6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.524594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55f68-b61d-429f-81e2-23627a09baf6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.526210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 425/863] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:14.532043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.532464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.532782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.552475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:14.553708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:14.627215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34455550-eb65-472f-ab1e-465b1f5d0ba8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:14.638110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 426/864] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:14.658004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:14.659051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.659549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.660051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.663584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:14.671808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:14.673588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:14.686625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:14.688552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:14.690727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 439/865] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:14.696209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.787710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:14.807005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea4f26-8aeb-4906-842c-6d1d02fb6f43 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:14.844400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:14.845033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:14.845308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:14.845578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:14.846317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:14.846618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:14.848102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:14.867940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 427/866] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:14.874259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:14.932310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.000876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603211-fcdf-41aa-b6b1-7d1ac31654b1 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.047053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94fb-42b9-48f9-949a-c0f558dd08c9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.049284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.049909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.051078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.051407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.100187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.100811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.101093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.101368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.102434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.104235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5793-1264-40f5-8702-33d77bab6d85 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.124064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.130621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 428/867] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:14 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:15.132049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8125-1914-4fc4-aa89-2013169ba739 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.132341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8125-1914-4fc4-aa89-2013169ba739 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.132608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb8125-1914-4fc4-aa89-2013169ba739 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.134847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 429/868] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:15.140535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.140875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.141066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.143275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.146243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.152194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.165446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:15.167315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:15.283228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 430/869] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:15.295203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 440/870] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:15.301408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.450417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092cabf-8fa8-4900-8cd7-bc462eb65261 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.480767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.489225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.489866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.490140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.490408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.501562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.503094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:15.518724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:15.520574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:15.522231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:15.522231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:15.522231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:15.522231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 431/871] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:15.528707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.552760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.651616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.662824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020305-5381-4c2d-b09a-f9f8d4f10477 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.678702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c82f65-725a-42f1-b055-bbe32e60e4f4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.711486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.712818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.713177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.713637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.714400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:15.714777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.716465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160ec69-ecbf-4898-abee-8e3731c3e6bb None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.717680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.718641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.719221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.719632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.720356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.721905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.730813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 441/872] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:15.731770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:15.732722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:15.733538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 432/873] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:15.736692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86798de-0e03-4f54-857e-dcc04b554ac8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.736970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86798de-0e03-4f54-857e-dcc04b554ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.737239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86798de-0e03-4f54-857e-dcc04b554ac8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.738747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 442/874] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:15.739524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86798de-0e03-4f54-857e-dcc04b554ac8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.739633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:15.790191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.857030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86798de-0e03-4f54-857e-dcc04b554ac8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.872081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7834bf-b472-4782-8226-a9c32c9c21fe None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:15.898141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.899003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.899509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.899965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.901048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:15.901555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.904559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fdc5f-13ae-4c24-9c02-861d5249caa1 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.914587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 443/875] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:15.914587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.914587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.914587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.917010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:15.917787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:15.918059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:15.918324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:15.926169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:15.927690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:15.932734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:15.934281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:15.947347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:15.948430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:15.949548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:15.951956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:15.954143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 433/876] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:15.955105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:16.012212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 444/877] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:16.013516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:16.081046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe6a9-ce1d-49e0-a8fa-6ea27d9bac73 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:16.083622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:16.132827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:16.133388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:16.133667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:16.133935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:16.134580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:16.134902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:16.137242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:16.146831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be1fa-cf99-4254-9b11-f3958e8b0752 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:16.147387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 434/878] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:16.205735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:16.206805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:16.207280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:16.207755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:16.208635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:16.209093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:16.210886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:16.234555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 445/879] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:16.237280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:16.315551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:16.327549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:16.371666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e01b4c-bb4e-4aa7-a2aa-ac211cd017c5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:16.409673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:16.410275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:16.410557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:16.410814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:16.411572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f4977f2d1c1c46b7995f02caeb81cc8f) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:16.411864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:16.413599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc255-2f1f-4994-b550-e75aad7688ca None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:16.427357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 435/880] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:16 2022] GET /identity/v3/role_assignments?user.id=f4977f2d1c1c46b7995f02caeb81cc8f&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:16.432983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aadef-2af3-4fa9-bc57-1f6b95bc733b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:16.473281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:16.473920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:16.474200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:16.474473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:16.475173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:16.476639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba23f-f53a-4c0d-b7ca-e7678e94c50d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:16.497243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 446/881] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:16 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:17.251421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c008e-4f61-432d-b78e-cfa2fe86b698 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:17.252073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c008e-4f61-432d-b78e-cfa2fe86b698 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:17.252073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c008e-4f61-432d-b78e-cfa2fe86b698 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:17.253632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 436/882] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:17.259200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:17.259686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:17.259770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:17.278633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:17.279868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:17.350615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:17.363519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 447/883] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:17.624615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c008e-4f61-432d-b78e-cfa2fe86b698 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:17.668401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:17.759832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c008e-4f61-432d-b78e-cfa2fe86b698 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:17.802937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:17.803632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:17.804071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:17.804341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:17.804933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:17.806317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:17.815694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:17.816770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:17.817649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 437/884] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:17.823704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:17.938145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9b02-f210-4de7-8e8d-9aa9242a2fbc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:17.976214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:17.976907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:17.977190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:17.977459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:17.978115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:17.978424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:17.979842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:17.985595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 448/885] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:17.991151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:18.104467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:18.110338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c5e-dbb6-44f3-92a8-720543cccea9 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:18.147261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:18.147876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.148148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.148416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.149046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:18.149341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:18.150860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:18.157187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 438/886] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:18.162909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:18.237752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:18.283057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c557f7-91a4-4b4e-b22e-7702615a0b61 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:18.320710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:18.321332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.321665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.321935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.322640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] RBAC: Adding query filter params (interface=public, service_id=1a591e6a14d94c1b98ccd532f8a4fe6a, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:18.322945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:18.324411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443db94-6382-4fea-a9e3-e5c1860f7e76 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:18.332932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 449/887] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:18 2022] GET /identity/v3/endpoints?service_id=1a591e6a14d94c1b98ccd532f8a4fe6a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:18.338394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:18.340863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ff38-ac7a-4f00-8152-f99cda131951 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.341163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ff38-ac7a-4f00-8152-f99cda131951 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.341420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ff38-ac7a-4f00-8152-f99cda131951 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.343062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 450/888] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:18.348898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68cb6-e384-4c1f-9a44-8c99e7e912c4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.349229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68cb6-e384-4c1f-9a44-8c99e7e912c4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.349414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68cb6-e384-4c1f-9a44-8c99e7e912c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.371248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9ef68cb6-e384-4c1f-9a44-8c99e7e912c4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:18.372494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9ef68cb6-e384-4c1f-9a44-8c99e7e912c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:18.445724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 451/889] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:18.472176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80f3a7-5d9a-4242-bedc-b7ab17250a31 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:18.513701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:18.514696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.515159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.515651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.516444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:18.518077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fdfb-d954-4654-8296-fdf14f4bb927 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:18.525155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 439/890] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:18 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:01:18.592734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aad9f-ceb7-4f96-9f61-984a7d6cb7d4 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.593144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aad9f-ceb7-4f96-9f61-984a7d6cb7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.593360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aad9f-ceb7-4f96-9f61-984a7d6cb7d4 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.595122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 452/891] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:18.601070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893229-b317-4094-8075-18839032da6b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.601382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893229-b317-4094-8075-18839032da6b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.601614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893229-b317-4094-8075-18839032da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.612271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c764-b73b-4219-8c94-41c869940157 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.612579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c764-b73b-4219-8c94-41c869940157 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.612824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c764-b73b-4219-8c94-41c869940157 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.615588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 453/892] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:18.620518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.620805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.621085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.640927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:18.642162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:18.642611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-25893229-b317-4094-8075-18839032da6b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:18.644199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-25893229-b317-4094-8075-18839032da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:18.674774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:18.703240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:18.736240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 454/893] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:18.747621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 440/894] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:18.761055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:18.870762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb76e6-3b39-4eef-951e-ad8477ac2d29 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:18.914437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:18.915432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:18.915878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:18.916318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:18.917462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:18.919859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:18.946805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 455/895] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:18 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:19.026109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893229-b317-4094-8075-18839032da6b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.071644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.150406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:19.215148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893229-b317-4094-8075-18839032da6b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.241357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ee40a-5698-4aaf-9e94-215fe0532694 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.266690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.267489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.267834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.268161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.268906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.270970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:19.283429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:19.284457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:19.285348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 441/896] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:19.286128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.286563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.286563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.286703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.293052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.301321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:19.305538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:19.306473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:19.307343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 456/897] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:19.318567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.323369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:19.465364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79551cf4-f74b-4598-b21e-9247ff64c259 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.477902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:19.486084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b3cf3-20ad-4512-ac10-78c159f48e40 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.521810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.522669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.522951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.523244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.524289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:19.524600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.526263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.529819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.530710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.531224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.531704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.532440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 442/898] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:19.532839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:19.533250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.534638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.537746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.555378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 457/899] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:19.558024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.663068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:19.680356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3acaa-990d-45ce-b3ab-f316e553bd8e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.687537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e952-9d58-4967-9fac-64276c66a181 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.721778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.722779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.723230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.723697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.725806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.726619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.727052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.727531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.728330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:19.728821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.730457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.735761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.741524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.741796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 443/900] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:19.742971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:19.753832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:19.755029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:19.756221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:19.756221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:19.756221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:19.760010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 458/901] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:19.761490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.778624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:19.862887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650a921-354e-41b8-81dc-e680e88ba098 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.873144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177d4d-5c9e-4b9f-add0-75b6ca639a66 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:19.911929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.912559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.912995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.913239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.914110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:19.914484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.916132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.920677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:19.921900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:19.922698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:19.923244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:19.924217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] RBAC: Adding query filter params (interface=public, service_id=0eb28827e9e4425c84b272a1becfda03, region_id=RegionOne) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:19.924715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:19.926306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:19.937291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 459/903] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:19.937291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.937886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 444/903] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/endpoints?service_id=0eb28827e9e4425c84b272a1becfda03&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:19.941704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:19.959426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:20.018054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:20.054452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404f6b-fe26-44ed-81e4-12a4940570cf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:20.072939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98af63b-eecc-4092-baf4-8187747386db None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:20.093059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:20.093985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.094442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.094860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.103414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:20.105278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:20.119073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:20.120101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:20.121167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:20.128070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:20.128070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.128070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.128070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.128523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:20.128523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:20.128735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 460/904] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:20.130358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:20.143905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 445/905] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:19 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:01:20.253664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917713ad-7555-419d-bd9f-2c110c90baf5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:20.289919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:20.297989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:20.298888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.299338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.299761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.300655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:20.301138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:20.302756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9104bf5-d9c6-44b2-aadb-5cf24e6a0423 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:20.323109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 461/906] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:20.329182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:20.411420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:20.445353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a670da-8af9-4ee4-9d24-ffe1a8076a4a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:20.482498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:20.483994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.484487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.484955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.559468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:20.561281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:20.616567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7c8d1-d83b-4912-9056-0b1edeaa3acd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.616853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7c8d1-d83b-4912-9056-0b1edeaa3acd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.617104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7c8d1-d83b-4912-9056-0b1edeaa3acd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.618674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 462/907] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:20.624498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.625097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.625602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.645506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:20.647070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:20.649663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:20.699473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 446/908] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:20.705165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:20.755618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 463/909] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:20.834118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036db1-882e-45d8-922f-b08a2c1821bc None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:20.874335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:20.875401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:20.875910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:20.876374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:20.890666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:20.892529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-23445cc6-704e-4105-a19e-c55fca47309f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:20.915569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:20.917411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:20.920453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:20.920453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:20.920453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:20.922459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 447/910] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:20.928975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.008510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9d3-6763-42f9-a3a3-d4175ce11b90 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.009580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9d3-6763-42f9-a3a3-d4175ce11b90 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.010348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ce9d3-6763-42f9-a3a3-d4175ce11b90 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.013879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 448/911] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:21.020101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.020448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.020706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.042878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:21.043886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:21.068619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.111813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c64d0-0e29-4749-a591-6b1ba1421ce4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.118205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 449/912] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:21.122471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.143949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.160972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.161679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.161958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.162238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.163099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.163370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.164883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.179530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 464/913] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.185983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.260662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ca65b-c88d-4d3a-9768-3f38eca93075 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.302115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745ffa-c1ec-42cb-83b1-f5cb10298940 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.308398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.309070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.309346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.309615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.310219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.311738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:21.323467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:21.324653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 13:01:21.325458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:21.328506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 450/914] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:21.339278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.353655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.354954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.356326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.356742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.365464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.367677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.369695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:21.386872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:21.388023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:21.389231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 465/915] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:21.390216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.451332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.466069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1836e-126c-410c-b265-d4f2216ac3f7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.500965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.501679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.501853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.502123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.502760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.503058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.504494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.509394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 451/916] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.510218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.533513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd5c5-760f-4904-ac2c-cd7601c38ec7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.579150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.580234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.580684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.581271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.582522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.584344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:21.596063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:21.597137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:21.597977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:21.600992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 466/917] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:21.602143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.607151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.625791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2667c1-5fec-4c57-b751-6ca9cff2e991 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.672573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.673200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.673479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.673747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.674446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.674753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.676246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.691289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 452/918] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.696384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.724177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657417-38b1-4713-bb76-27d6541760f4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.726598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.765460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.766203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.766545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.766878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.767633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.767932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.769304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.774689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 467/919] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.775573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.810801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d105-f092-4ef6-9ce3-5e9eeea19779 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.856570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.857194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.857472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.857742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.858379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.858721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.860155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.866803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 453/920] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.867445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:21.883332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:21.905073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf5a5a-2fb1-494f-994d-0a2ad2c92a7f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:21.947129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:21.947844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:21.948111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:21.948378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:21.949222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] RBAC: Adding query filter params (role.id=707a08c96c504a1599c1596c731f72bd, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f4977f2d1c1c46b7995f02caeb81cc8f) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:21.949534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:21.951812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:21.963261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 468/921] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/role_assignments?user.id=f4977f2d1c1c46b7995f02caeb81cc8f&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=707a08c96c504a1599c1596c731f72bd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:21.963261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:22.004562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d4afd-215b-45a4-976b-0448f0e9f8e1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.005345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:22.057670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.058523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.058805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.059078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.059926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.061382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:22.091791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 454/922] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:22.102830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae2751-09d0-4029-9f35-4260b7b62193 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.155062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.155801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.156079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.156341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.156985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:22.157287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.158690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582454d-6ca8-4c87-b07b-b4df21430d2e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:22.165100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 469/923] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:22.171164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:22.196026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f76b-ffb4-4bb9-ab56-7c21a0cba6b6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.196499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f76b-ffb4-4bb9-ab56-7c21a0cba6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.196985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f76b-ffb4-4bb9-ab56-7c21a0cba6b6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.199772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 470/924] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:22.208469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.208797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.209586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.233805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:22.235076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:22.263013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:22.324989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d0edc-c911-4b85-bd8b-98316b5cd7ab None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.343218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 471/925] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:22.381257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.382000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.382286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.382563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.383307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] RBAC: Adding query filter params (interface=public, service_id=b42b03c1842a43fe9cf8294ead6cf137, region_id=RegionOne) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:22.383620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.385027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:22.391291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 455/926] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:22 2022] GET /identity/v3/endpoints?service_id=b42b03c1842a43fe9cf8294ead6cf137&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:22.396668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:22.430133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:22.515346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04880-607c-4493-a7e7-a16db90bef63 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.553003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.553636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.553917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.554190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.554815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.556329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:22.563541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 472/927] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:22 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:01:22.636919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:22.757486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581fe83-0fc2-4aed-9558-df4f9f8f2a76 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.800822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:22.809461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.810117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.810397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.810673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.811299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.812780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:22.822516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:22.824704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 13:01:22.826757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:22.831209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 456/928] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 13:01:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:22.831422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:22.932737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:22.952163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521af9c2-c416-4f6b-8b1c-6d0854b9a88b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:22.989382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:22.990005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:22.990286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:22.990564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:22.991223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:22.991679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:22.993062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:23.002998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 473/929] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:23.004547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:23.131143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26219135-60ab-4e5a-8e3d-868b52aa8029 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:23.183755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:23.184406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:23.184684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:23.184954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:23.185603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:23.185974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:23.187406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd2199-4424-482e-923a-e50baa6fd75f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:23.200722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 457/930] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:23.204629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:23.316164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d42-fae1-49b6-b64a-30029d85b669 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:23.352943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:23.353759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:23.353946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:23.354096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:23.354788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:23.356225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0c7ae-b65a-4d57-bd86-434fb09483bd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:23.383723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 474/931] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:23.994318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb920c-35f1-4278-8a7e-5273d3c01239 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:23.995423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb920c-35f1-4278-8a7e-5273d3c01239 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:23.995930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb920c-35f1-4278-8a7e-5273d3c01239 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:23.997776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 458/932] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:24.003640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b492-78e1-4091-b48f-78dd6711d6a7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.004206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b492-78e1-4091-b48f-78dd6711d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.004670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b492-78e1-4091-b48f-78dd6711d6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.019782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:24.025798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7ee9b492-78e1-4091-b48f-78dd6711d6a7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:24.027814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7ee9b492-78e1-4091-b48f-78dd6711d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:24.118453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 475/933] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:24.159261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236b81-4dfb-45d9-92a1-738ccb5d7941 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.159578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236b81-4dfb-45d9-92a1-738ccb5d7941 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.159822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236b81-4dfb-45d9-92a1-738ccb5d7941 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.161443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 459/934] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:24.167468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.167811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.168147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.188171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:24.189518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:24.265814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 476/935] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:24.389572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236b81-4dfb-45d9-92a1-738ccb5d7941 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:24.459605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:24.514369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236b81-4dfb-45d9-92a1-738ccb5d7941 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:24.556195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:24.556767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.557042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.557311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.561208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:24.573568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:24.582056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:24.583080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:24.583939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:24.584568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 460/936] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:24.595297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:24.654971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:24.699498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb955-f886-42fc-ab9e-0ba600d16ebd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:24.710081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03806-b0b4-46e9-939f-73b8084c8313 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:24.727438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:24.741458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:24.742586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.743102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.743612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.744491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:24.746223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:24.747780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:24.748403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.748683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.748953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.749633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:24.749941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:24.750663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING keystone.server.flask.common [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 13:01:24.751429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:24.765584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 461/937] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:24.766727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:24.782245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.sql.core [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 13:01:24.782245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 13:01:24.782245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [parameters: {'id': '963b9c596f19408983f15675f34bbf3a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 13:01:24.782245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-a5afee6c-2ce8-492c-99c3-de24e278991e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 963b9c596f19408983f15675f34bbf3a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 963b9c596f19408983f15675f34bbf3a. Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:01:24.790001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 13:01:24.790861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application yield resource Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise self.value Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application session.commit() Aug 24 13:01:24.791817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.flush() Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application compat.raise_( Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 13:01:24.792742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 13:01:24.793639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:01:24.794425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [parameters: {'id': '963b9c596f19408983f15675f34bbf3a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.795429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:24.796214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 963b9c596f19408983f15675f34bbf3a. Aug 24 13:01:24.797219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:24.803205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 477/938] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 24 13:01:24 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:24.803205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791708a-46ff-4049-b43f-e52b9d5c7f27 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.803205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791708a-46ff-4049-b43f-e52b9d5c7f27 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.803205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791708a-46ff-4049-b43f-e52b9d5c7f27 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.806015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 478/939] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:24.807085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791708a-46ff-4049-b43f-e52b9d5c7f27 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:24.914820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a9d7-c30f-4f4e-8109-7cd54f85fb07 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:24.944396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791708a-46ff-4049-b43f-e52b9d5c7f27 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:24.956389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:24.957062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.957314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.957583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.966180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:24.972021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:24.974401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:24.988903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:24.989823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.990098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.990367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b6f85d58-1c6b-4ffa-a0ec-cafaa12a7aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:24.994635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:24.996950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:24.997834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:24.997834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:24.997834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:24.997834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 462/940] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:24.997834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:24.998122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:24.998678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.003442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.005050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:25.018238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:25.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:25.020681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:25.021105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:25.021105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:25.023896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 479/941] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:25.027538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.048386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:25.112147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 463/942] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:25.112952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.172761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e282-f05b-495e-9684-65efbf21299f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.222998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.224181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.225340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.225875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.227047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:25.227624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.230309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.240437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05e49-11d2-4812-b40d-00c925ffb5eb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.248626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 480/943] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:25.255970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.301561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.302189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.302482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.302949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.303488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:25.303788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.305331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.318026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:25.331228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 464/944] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:25.383105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.406143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1f244-655d-4589-8301-efeec5be4ace None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.409739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:25.473484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.474632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.475124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.475704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.486611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.488137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-9890986f-c463-4bdd-91c8-209b0cdf9606 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:25.502159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:25.503960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 481/945] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460307-d37e-4336-9b1f-5466e22767fd None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.505915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460307-d37e-4336-9b1f-5466e22767fd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.507380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460307-d37e-4336-9b1f-5466e22767fd None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.507380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 482/946] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:25.510919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9460307-d37e-4336-9b1f-5466e22767fd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.518232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c67e-864f-495d-8841-27045bbd4b32 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.568083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.568083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.568373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.568596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.569190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.570614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-edd50892-f36d-4a12-81f7-471349c3fd88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:25.580677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:25.583025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:25.583893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 465/947] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:25.584670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.584670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.584670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.604881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:25.611640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:25.637922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:25.645154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9460307-d37e-4336-9b1f-5466e22767fd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.696880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.697499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.697775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.698043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.699060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:25.699167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 466/948] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:25.699293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.700745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.708160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.729599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 483/949] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:25.731271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:25.736480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.840828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de219e-d87e-44cb-b762-747f7c361477 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.876740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ddf2a-10ba-44e2-9438-32d3f4e3106c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:25.897041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.898359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.898902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.899849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.900861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:25.901368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.904518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.913658 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 467/950] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:25.923682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:25.945584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:25.946619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:25.947097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:25.947712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:25.974354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:25.978189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:25.996746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:25.997756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:25.998608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:25.998608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:25.998608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:26.008268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 484/951] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:26.008760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.024993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.067601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.101507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90e1c-808a-41d3-aa8d-f3d3df0511de None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.142797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d14fbc-1a10-4840-8ccc-b48b6670270e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.146285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.146285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.146489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.146681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.148483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:26.148746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.150170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.158901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 468/952] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:26.159789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.196023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.196679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.196957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.197228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.197817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.199324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:26.208694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:26.210099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:26.210973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 485/953] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:26.211845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.321054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.333409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979bd2-7262-4f5f-abe0-91b59bdf67e7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.365841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb41f4d-6001-41e6-b49f-db5da1ad2abe None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.381484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.382107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.382381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.382761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.383552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:26.383851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.385252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.399396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 469/954] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:26.400163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.403553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.412714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.412714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.412714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.412714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.413196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.413196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.447239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 486/955] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:26.447239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.545036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075e29-d453-4560-bf74-1546f240a62e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.593125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.593775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.594066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.594329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.594997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:26.595366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.596865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.599904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73019293-f518-4f0f-b496-e9c4078ec9e7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.603040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 470/956] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:26.610762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.629197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.643175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.643873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.644229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.644495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.652773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.655099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:26.668271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:26.669279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:26.670168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 487/957] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:26.675643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:26.705895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:26.775390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bd560-2657-4322-bbc1-bb821090b6ef None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.800211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d130-ea4e-4ccf-b93a-bbc1f33ce399 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:26.822207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.822838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.823117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.823496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.824144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:26.824453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.825868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.837586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 471/958] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:26.857603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:26.858649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:26.859221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:26.859706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:26.860662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:26.861190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:26.862991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59cf0-1049-4662-a2e3-d1bce6ecea57 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:26.878599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 488/959] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:26.884861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:27.013515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf785c-33bf-473c-8a6e-7e4480a60a25 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:27.043711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:27.055426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:27.056126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:27.056408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:27.056682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f4977f2d1c1c46b7995f02caeb81cc8f/roles/707a08c96c504a1599c1596c731f72bd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:27.058992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=f4977f2d1c1c46b7995f02caeb81cc8f, role_id=707a08c96c504a1599c1596c731f72bd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:27.060578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ceaa5-a9cf-43ca-ae6e-74ebcbed9574 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:27.080114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 472/960] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:26 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f4977f2d1c1c46b7995f02caeb81cc8f/roles/707a08c96c504a1599c1596c731f72bd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:01:27.554694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010656-f337-454e-be20-d18130c7295e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:27.555210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010656-f337-454e-be20-d18130c7295e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:27.555686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48010656-f337-454e-be20-d18130c7295e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:27.557391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 489/961] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:27.563087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:27.563415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:27.563691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:27.582915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:27.584152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:27.679120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 473/962] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:27.982118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010656-f337-454e-be20-d18130c7295e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:28.050820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:28.148328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48010656-f337-454e-be20-d18130c7295e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:28.188838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:28.189448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.189721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.189987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.190633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:28.192370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:28.212972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.sql.core [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 13:01:28.212972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 13:01:28.212972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [parameters: {'user_id': '54f4b8952dd4463f82ce6569ef9367bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 13:01:28.212972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:01:28.221994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:01:28.222944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application yield resource Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application next(self.gen) Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise self.value Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application session.commit() Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 13:01:28.223923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.session.flush() Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application compat.raise_( Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 13:01:28.224811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 13:01:28.225736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application conn.query(q) Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application result.read() Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 13:01:28.226578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [parameters: {'user_id': '54f4b8952dd4463f82ce6569ef9367bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:28.228720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 13:01:28.230542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:28.232806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 490/963] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 13:01:27 2022] POST /identity/v3/users => generated 160 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:28.234424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:28.350821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32adc1a-737e-4d02-aa71-1810e8e060ba None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:28.369340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:28.389057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:28.389967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.390240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.390506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.401844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:28.403707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-3533c963-64e2-46dd-904a-c1912fda72ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:28.418751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:28.419798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:28.420714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 474/964] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:28.426258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:28.504880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71eb2-dff6-447c-bb92-50e86f82b2fe None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.505544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71eb2-dff6-447c-bb92-50e86f82b2fe None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.506019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b71eb2-dff6-447c-bb92-50e86f82b2fe None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.508008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 475/965] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:28.514031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fc147-b646-48cf-a39c-5493456d2911 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.514661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fc147-b646-48cf-a39c-5493456d2911 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.515128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fc147-b646-48cf-a39c-5493456d2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.541625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a159a-4a65-4a76-8fcf-6682d321f932 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:28.542294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-514fc147-b646-48cf-a39c-5493456d2911 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:28.543944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-514fc147-b646-48cf-a39c-5493456d2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:28.551784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:28.595308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:28.595308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.595656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.595741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.596462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:28.596759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:28.598434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:28.634213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 476/966] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:28.646607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 491/967] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 13:01:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:28.910799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901aee7-4db3-4912-8866-9e70b30b9aa5 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.910799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901aee7-4db3-4912-8866-9e70b30b9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.910799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901aee7-4db3-4912-8866-9e70b30b9aa5 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.912076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 477/968] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:28.912589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:28.918918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:28.919374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:28.919649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:28.941622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:28.943103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:29.020359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 478/969] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:29.032229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162687f-bd87-41bf-b2a0-c9d1b564fe2f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.083715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.084381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.084659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.084930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.085536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.086949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0fbb166e-56fb-4d7a-9060-80e14d7e5a7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:29.096599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:29.097767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:29.100053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 492/970] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:29.105002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.126963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec165-5b02-44bf-be7b-e87c1e50e93c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.127453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec165-5b02-44bf-be7b-e87c1e50e93c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.127889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec165-5b02-44bf-be7b-e87c1e50e93c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.130297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 493/971] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:29.142331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.142331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.142331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.154244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.159586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:29.161749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:29.196874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.248632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9270b-4ac1-4c2d-9f0a-2d284600ba99 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.251438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 494/972] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:29.285375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.304490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.305452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.305898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.306343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.307534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:29.307974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.310380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.323258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 479/973] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:29.326636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.419726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a2aff-a82d-45e7-a651-cd4a414a9cb6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.443992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.447314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2811-4b23-4f5f-b78e-7696d4e14f41 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.462631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.463299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.463556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.463840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.464780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.466705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.491983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 495/974] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:29 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:29.500397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.501144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.501493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.501826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.502583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:29.502958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.504525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.516847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 480/975] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:29.524853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.525000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.551344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.652525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8b8d-4f79-4d8a-a914-7328c90b2df7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.675205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b0b8-dcbc-4668-bad3-49f94fcd2a70 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.694253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.694911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.695212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.695505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.706526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:29.711380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:29.712297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:29.713372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 481/976] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:29.718950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.719710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.719988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.720256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.720542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.721001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] RBAC: Adding query filter params (interface=admin, service_id=b42b03c1842a43fe9cf8294ead6cf137, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:29.721297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.722837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.729612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 496/977] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/endpoints?service_id=b42b03c1842a43fe9cf8294ead6cf137&interface=admin®ion_id=RegionOne => generated 193 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:29.736234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.750676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.842125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:29.861420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e613fa-7d63-4cb6-863b-ff99b6485ceb None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.871401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc8e5-c5e5-44bd-9b7c-2a4f000d434b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:29.906160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.906872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.907171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.907451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.908194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:29.908474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.910097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.914246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:29.915299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:29.915765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:29.916246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:29.917411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:29.919308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:29.920231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 482/978] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:29.925916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:29.931748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 497/979] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/services => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:01:30.044482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:30.076066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b761-82e1-4738-9900-ffa9569f327c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:30.117742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:30.118719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:30.119232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:30.119689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:30.144164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:30.146017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:30.162497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:30.163551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:30.164423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:30.164423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:30.164423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:30.166257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 483/980] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:30.172515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:30.291781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb6b2-d0c4-4abd-a929-2c6cb03d3f8c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:30.337885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:30.338653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:30.338974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:30.339296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:30.340066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:30.340405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:30.342041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:30.355910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 498/981] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:30.361512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:30.492899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977908-33b7-4b9d-8edf-6725609ccee5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:30.531231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:30.532281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:30.532561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:30.532818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:30.535418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:30.543127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:30.545201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:30.557234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:30.558493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 13:01:30.560009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:30.563266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 484/982] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:01:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:30.565054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:30.575655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:30.709064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36310b-5295-4bce-a6de-847c8f050ff0 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:30.750681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:30.751354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:30.751611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:30.751877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:30.752623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:30.752928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:30.754372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:30.773302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 499/983] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 13:01:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:30.779381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:30.894730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057447b9-dbbd-4c2b-9dd5-1c0b3694b564 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:30.939707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:30.940734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:30.941179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:30.941589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.013755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:31.025104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:31.026841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:31.138075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 485/984] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:30 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:31.143817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:31.210370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:31.268303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564ed1-3ecb-4202-8fff-1075d58e3c2b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:31.309437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:31.310092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.310333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.310635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.327563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:31.330116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-79cd3953-d94f-46c8-8cfc-5f2ae93a885a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:31.346203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:31.348006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:31.349541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:31.349541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:31.349541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:31.350427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 500/985] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:31.353856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:31.484433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:31.494104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceefbec-357c-4077-9a97-a09ab0de8ac2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:31.496017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8cde-4727-4c03-a5f5-2213d272730a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.496299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8cde-4727-4c03-a5f5-2213d272730a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.496560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8cde-4727-4c03-a5f5-2213d272730a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.497925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 501/986] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:31.503547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.503870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.504084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.534966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:31.536334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:31.537856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:31.538567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.538805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.539073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.539787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:31.540087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:31.541451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:31.555868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 486/987] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:31.562788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:31.627794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 502/988] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:31.678607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da41f0-344a-4fa0-b7e2-7531bbfe4a6e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:31.728276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:31.728914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.729162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.729458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.737206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:31.738635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ae367037-a058-4a14-aeea-d518956d1868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:31.750957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:31.757678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:31.758677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 487/989] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:31.760504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:31.815693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:31.848295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d032-32f8-410b-8e2b-3c1f6fc353ea None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.848541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d032-32f8-410b-8e2b-3c1f6fc353ea None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.848832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d032-32f8-410b-8e2b-3c1f6fc353ea None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.850322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 488/990] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:31.855791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.856091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.856353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.874778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:31.875584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52e88-cd21-4e47-b804-65d35d3896d7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:31.875992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:31.886537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:31.915309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:31.915934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:31.916210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:31.916482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:31.917225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:31.917527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:31.918983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:31.931422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 503/991] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:31.932270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:31.950580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 489/992] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:31.951484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.055618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872cbde-6441-4487-8653-a17225477d72 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.067912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.077241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a284-7864-416e-9818-5a72c63dca35 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.106418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.107415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.107688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.107960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.109899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.110018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:32.119125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:32.120189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:32.121015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 504/993] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:32.123884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.124453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.124756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.125005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.125800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] RBAC: Adding query filter params (role.id=707a08c96c504a1599c1596c731f72bd, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f4977f2d1c1c46b7995f02caeb81cc8f) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.126106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.126485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.127967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.143239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 490/994] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:31 2022] GET /identity/v3/role_assignments?user.id=f4977f2d1c1c46b7995f02caeb81cc8f&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=707a08c96c504a1599c1596c731f72bd => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:32.218939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.232664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.269213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74418e-09b9-45a4-9c5f-edcf66f23db8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.316376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.316919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.317195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.318299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.318299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.318511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.319832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.325539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 505/995] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:32.331958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.367945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a49-11c8-490e-bc2c-f63d5b60c003 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.373172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.408475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.409132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.409410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.409714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.410310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.411764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:32.421348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:32.423352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:32.424841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 491/996] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:32.428664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.458659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70ad9-3dd0-45fa-a03a-e137c6dc1fc4 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.500735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.501399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.501680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.501951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.502955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.503293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.504871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.510495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 506/997] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:32.516490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.520963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.563929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a66d-bcd9-4d7f-9346-319de013b315 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.613857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.614406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.614882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.615309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.615958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.616262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.618340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.624187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.629982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 492/998] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:32.630187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfeac6-1340-4177-9dcf-8fecc4e344b8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.631638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.693673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.694297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.694575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.694844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.695609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] RBAC: Adding query filter params (interface=public, service_id=9cae842e8c2d465ca46feac5c40127e3, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.695950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.697347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.703416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 507/999] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/endpoints?service_id=9cae842e8c2d465ca46feac5c40127e3&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:32.709189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.763038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f19299-8fa1-4e02-9ccc-9dfb3dfcb5d5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.803363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.803977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.804258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.804531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.805173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:32.805468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.806868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.810914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:32.819574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 493/1000] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:32.820535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:32.834585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389607-7435-43df-86cc-b7e699c722dd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:32.878384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:32.879216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:32.879484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:32.879753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:32.880547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:32.882312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5aae3-a8e7-4f5d-8e66-51562bcf2180 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:32.889671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 508/1001] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:32 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:01:32.966842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98beb80f-fa99-42d3-8362-17c1593e17f4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:33.021489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:33.022718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:33.023260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:33.023758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:33.024683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:33.026401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d03b2-40d6-4ef4-9992-15c9f879ce33 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:33.048270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 494/1002] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:34.111723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050e5c-229f-4d0f-ab30-a8d90f56e270 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.112273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050e5c-229f-4d0f-ab30-a8d90f56e270 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.112273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050e5c-229f-4d0f-ab30-a8d90f56e270 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.113740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 509/1003] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:34.119043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.119559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.119665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.140646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:34.141837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:34.204918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:34.229440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 495/1004] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:34.492808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050e5c-229f-4d0f-ab30-a8d90f56e270 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:34.521413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:34.609938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050e5c-229f-4d0f-ab30-a8d90f56e270 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:34.648994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:34.649638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.649911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.650177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] PATH_INFO: `/v3/services/image` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.650763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:34.652182 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4df52956-e86f-420d-b319-d2773f67826b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:34.666613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:34.668021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:34.668841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:34.671572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 510/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 13:01:34 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:34.673891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:34.804008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd0cfd-c295-433e-803f-36e24fb13a08 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:34.823227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a96e9-fd08-4b34-bcc9-6ef762d71a46 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.823571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a96e9-fd08-4b34-bcc9-6ef762d71a46 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.823843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a96e9-fd08-4b34-bcc9-6ef762d71a46 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.825214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 511/1006] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:34.830892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6293ca5-bbc2-4aff-beb4-8d90107657ff None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.831285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6293ca5-bbc2-4aff-beb4-8d90107657ff None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.831623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6293ca5-bbc2-4aff-beb4-8d90107657ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.844340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:34.845325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:34.845749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:34.846164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:34.846970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] RBAC: Adding query filter params (name=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:34.847446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:34.848994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:34.850675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a6293ca5-bbc2-4aff-beb4-8d90107657ff None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:34.851919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a6293ca5-bbc2-4aff-beb4-8d90107657ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:34.855216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 496/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:34.860903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:34.926710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:34.950489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 512/1008] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:34.985116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44384e-1255-4cf8-8ed9-9051fd3f6756 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.030575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.031223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.031500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.031755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.031856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae3c4-1d97-43b2-a8a2-29df09f673d3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.032159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae3c4-1d97-43b2-a8a2-29df09f673d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.032388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] RBAC: Adding query filter params (type=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:35.032484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae3c4-1d97-43b2-a8a2-29df09f673d3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.032693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.034009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 513/1009] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:01:35.034115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.039556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 497/1010] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:35.039726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.039847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.040121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.064267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:35.065940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:35.090577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:35.164110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 514/1011] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:35.228459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.348234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192222f4-d9cc-4c0e-b135-c83359bd4cba None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.365531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:35.389185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.389839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.390109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.390372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.390958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.392383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:35.401727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:35.403147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:35.404161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 498/1012] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:35.411425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.432407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.550746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cd68-daad-4992-83c4-c8f8d547c046 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.573100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0986-5681-4568-a050-18e430492838 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.591765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.592406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.592665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.593036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.593599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:35.594320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.595311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.603948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 515/1013] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:35.608709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.626524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:35.629527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.630480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.630883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.631335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.632540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.634021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.635869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 499/1014] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:35.641583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.698687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:35.737273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175af04-5558-4acb-8cab-314271e021b8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.761405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247d9b5-3066-47eb-ac4f-b0e1c68e77c1 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:35.782531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.783155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.783835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.783835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.784471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:35.784846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.786263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.799108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 516/1015] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 13:01:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:35.805273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:35.813046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:35.814081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:35.814560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:35.815588 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:35.816721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:35.819497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ae94a-6b43-4a1f-9337-ee72c44d40f3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:35.863571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 500/1016] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:35 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:35.926331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:35.955776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac327b-1dfa-46ec-a2ae-57593cbe492d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:36.007329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:36.007972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:36.008250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:36.008997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:36.009204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:36.010659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfaaf-8179-4361-9baf-97f58990e852 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:36.041438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 517/1017] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:36.997421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215710-e387-4416-af7b-8c3d9c9241b6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:36.997962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215710-e387-4416-af7b-8c3d9c9241b6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:36.998272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215710-e387-4416-af7b-8c3d9c9241b6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:37.000222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 501/1018] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:37.008786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a345-18e8-4ba0-b4f7-5ed5bf9e536b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:37.009326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a345-18e8-4ba0-b4f7-5ed5bf9e536b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:37.009606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504a345-18e8-4ba0-b4f7-5ed5bf9e536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:37.033293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1504a345-18e8-4ba0-b4f7-5ed5bf9e536b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:37.034510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1504a345-18e8-4ba0-b4f7-5ed5bf9e536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:37.119325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 518/1019] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:37.400045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215710-e387-4416-af7b-8c3d9c9241b6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:37.518971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:37.525679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215710-e387-4416-af7b-8c3d9c9241b6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:37.584772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:37.585394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:37.585668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:37.585937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:37.586651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:37.588213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9dae8-30ae-43b3-a9e1-40c212ded7fa None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:37.614113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 502/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:01:37 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:01:37.865062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203063-a90c-4ba6-8a77-6de94adb8093 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:37.865440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203063-a90c-4ba6-8a77-6de94adb8093 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:37.865615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba203063-a90c-4ba6-8a77-6de94adb8093 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:37.867052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 519/1021] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:37.872910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74f71-9276-4a9f-ae60-1b8c5cbad6a3 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:37.873231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74f71-9276-4a9f-ae60-1b8c5cbad6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:37.873431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d74f71-9276-4a9f-ae60-1b8c5cbad6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:37.896160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-72d74f71-9276-4a9f-ae60-1b8c5cbad6a3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:37.897378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-72d74f71-9276-4a9f-ae60-1b8c5cbad6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:37.982680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 503/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:38.098735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6198f-61e2-4b9c-aec8-9bd70e305b07 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.099308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6198f-61e2-4b9c-aec8-9bd70e305b07 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.099308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6198f-61e2-4b9c-aec8-9bd70e305b07 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.100802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 520/1023] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:38.105992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.106428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.106507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.125691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:38.126753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:38.208386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 504/1024] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:38.249692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6198f-61e2-4b9c-aec8-9bd70e305b07 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:38.325891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:38.382456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6198f-61e2-4b9c-aec8-9bd70e305b07 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:38.423425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:38.424064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.424335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.424596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.425849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:38.427395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:38.429253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 521/1025] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:38.435918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:38.460812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:38.475791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:38.586645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290349-ab11-42c0-8022-3b08a2154989 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:38.589908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75299d-f28b-4081-96a9-fcd6f55a9ce2 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:38.625292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:38.633696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:38.634409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.634606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:38.634738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.634950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.635279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.635899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.636001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:38.636082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.637193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:38.647224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:38.653329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:38.654306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:38.655122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 522/1026] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:38.662101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:38.679220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 505/1027] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:01:38 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:38.818519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac986-01ef-4290-8654-d202b09df24e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:38.858081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:38.858711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:38.858988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:38.859296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:38.859987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:38.860293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:38.862772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:38.871174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 523/1028] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:38.877124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:38.958935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:38.994320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7d49-db70-48e3-87d8-924b14be8b4d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:39.030841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:39.031521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.031800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.032085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.043563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:39.045040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:39.061974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:39.062988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:39.064749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:39.064749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:39.064749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:39.064749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 506/1029] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:39.069456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:39.123558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:39.192153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d298a6-189b-41ae-93d4-e18d24248f01 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:39.235257 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:39.235778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.236021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.236313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.236958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:39.237255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:39.238630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:39.252075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 524/1030] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:39.257854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:39.369506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166656a1-8613-4485-b3ed-1364e70b52ad None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:39.394115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:39.408003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:39.408650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.408988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.409262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.417701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:39.419359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b1306a8f-beb1-4085-83e3-95f72f525614 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:39.432868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:39.433890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:39.434807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 507/1031] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:01:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:39.441754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:39.549674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58724-97b7-458f-94e5-dd83732be3cd None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.550182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58724-97b7-458f-94e5-dd83732be3cd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.550308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58724-97b7-458f-94e5-dd83732be3cd None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.552139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 508/1032] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:39.556705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff94c4-69b9-4bff-bd39-8434e61361b5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:39.557967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.558556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.559008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.569485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:39.581126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:39.582612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:39.606577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:39.607922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.608561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.609234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.610761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:39.611493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:39.614185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:39.643073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 525/1033] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:39.643873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:39.673669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 509/1034] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:39.762568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1c3d4-01e9-4658-b61e-b17f3967caff None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:39.800655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:39.801691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:39.802166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:39.802640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:39.842537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:39.880125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:39.882020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:39.938847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.010418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 526/1035] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:40.016282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.062120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3567fd-d6d3-4ca1-b10a-5dbb8868711b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.080366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.097533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.110441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.111101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.111430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.111706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] PATH_INFO: `/v3/services/image` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.112306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.113716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:40.124239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:40.125473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:40.126293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 510/1036] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 13:01:39 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:40.131476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.148546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ff55a-e019-4e55-b995-287a894a272e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.196012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.196668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.196953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.197264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.209314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.210797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:40.227600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:40.228611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:40.234369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:40.234369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:40.234369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:40.234369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 527/1037] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:40.234759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.291537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca320-4be3-4b5b-ba63-27b63e01469e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.345751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.346249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.346591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.346843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.347454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:40.347756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.349150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.351923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356f84-88dc-4c87-8d83-6eef9ff31c3a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.358854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 511/1038] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:40.364514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.382284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.400848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.401528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.401806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.402069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.402727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:40.403404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.404791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.416407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.418233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 528/1039] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:40.424645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.500206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84156b-caae-4723-9b8a-4df6a44281b4 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.541799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2b4e-b40b-494f-b502-e06d4d55bef8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.560821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.561650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.561807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.562053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.562610 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:40.562913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.573535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.582838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.583520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.583795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.584063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.591203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 512/1040] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:40.593006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.600610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.602973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:40.622259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:40.623152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:40.624085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 529/1041] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:40.630328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.679990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.737225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ccd17-b282-4251-bad0-0d16d0b2b5a0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.741238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.752246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946c94-b6b6-4f61-bb02-69272ae36d9d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.779244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.780379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.780819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.781268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.782474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] RBAC: Adding query filter params (interface=public, service_id=80d9038352294953b2fbb4645a007643, region_id=RegionOne) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:40.782972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.785431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb544eb-4441-41c7-8d96-96d3c7f7eaf6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.789936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.790556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.790862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.791136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.791897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:40.792206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.798157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 513/1042] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/endpoints?service_id=80d9038352294953b2fbb4645a007643&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:40.798296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79d114-e234-4c3e-82df-07550ce4a600 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.798374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8ff2-07f7-4c3c-bc0e-7b3ce20f6bcc None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.798374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8ff2-07f7-4c3c-bc0e-7b3ce20f6bcc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.798374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8ff2-07f7-4c3c-bc0e-7b3ce20f6bcc None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.799018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 514/1043] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:40.800190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8ff2-07f7-4c3c-bc0e-7b3ce20f6bcc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.812678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 530/1044] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:40.814574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.814995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.815434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.842203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:40.844056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:40.918859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 531/1045] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:40.919747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:40.921206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8ff2-07f7-4c3c-bc0e-7b3ce20f6bcc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:40.955007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:40.965017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:40.965933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:40.966447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:40.966891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:40.967721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:40.969453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:40.978772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 515/1046] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:01:41.072936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef67fe-51ce-481e-b1d5-d5f4167ecfa8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:41.138665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:41.139680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:41.140679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:41.140679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:41.141824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] RBAC: Adding query filter params (role.id=707a08c96c504a1599c1596c731f72bd, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:41.142120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:41.145374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:41.152646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 532/1047] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:40 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=707a08c96c504a1599c1596c731f72bd => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:41.291111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:41.345152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:41.437080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893354-e134-4a26-9fc8-d71161202bdd None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:41.474027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:41.474668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:41.474944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:41.475233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:41.487699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:41.492298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:41.493266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:41.494108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:41.498773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 516/1048] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:41.499660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:41.624318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:41.632960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef1ed-5179-4f3e-afb7-602b182af83d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:41.677013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:41.677641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:41.677899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:41.678207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:41.678906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:41.679212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:41.680612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:41.691170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 533/1049] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:41.697049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:41.813079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:41.831587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d99c-ecbb-4712-a01c-d88aad885790 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:41.877381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:41.877934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:41.878206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:41.878474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] PATH_INFO: `/v3/users/7749be1159614f879156e6dd87247914` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:41.895329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] RBAC: Authorizing `identity:get_user(user_id=7749be1159614f879156e6dd87247914)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:41.896808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:41.898714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 517/1050] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:41 2022] GET /identity/v3/users/7749be1159614f879156e6dd87247914 => generated 285 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:41.904970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:42.034723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da75a81-5cd7-4851-be32-8b8063c8b9dd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:42.078285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:42.078902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:42.079174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:42.079465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:42.109206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:42.169789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:42.171232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:42.310502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 534/1051] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:42.316467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:42.425717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d966aa1-6337-416d-abee-64ffd49add3e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:42.466551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:42.467220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:42.467508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:42.467748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:42.468888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:42.470354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be1383-be6f-4fa1-af58-9bc2900067ea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:42.472285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 518/1052] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:01:42 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:42.478329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:42.538662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:42.590586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc4ef-6dcf-4f64-b1c2-d032a8549976 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:42.640505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:42.641128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:42.641408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:42.641679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:42.642407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=09c6e9b9e4424d929f2480d7521f1896, user.id=7749be1159614f879156e6dd87247914) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:42.642713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:42.644180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289083bf-f5af-40f6-a6d5-f43276fb942c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:42.653330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 535/1053] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:42 2022] GET /identity/v3/role_assignments?user.id=7749be1159614f879156e6dd87247914&scope.project.id=09c6e9b9e4424d929f2480d7521f1896&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:42.937114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7e0a-3cca-49a8-8920-a1d2f89b017d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:42.937461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7e0a-3cca-49a8-8920-a1d2f89b017d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:42.937694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7e0a-3cca-49a8-8920-a1d2f89b017d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:42.939210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 519/1054] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:42.944842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f06d-d707-414d-ac7a-da8f8a1e59d0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:42.945126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f06d-d707-414d-ac7a-da8f8a1e59d0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:42.945394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f06d-d707-414d-ac7a-da8f8a1e59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:42.966016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4245f06d-d707-414d-ac7a-da8f8a1e59d0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:42.967247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4245f06d-d707-414d-ac7a-da8f8a1e59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:43.058052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 536/1055] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:01:43.113509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dade2-96c6-402c-9fe5-78b32bd898cb None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.113885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dade2-96c6-402c-9fe5-78b32bd898cb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.114129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dade2-96c6-402c-9fe5-78b32bd898cb None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.116019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 520/1056] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:43.124791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.125330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.125791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.151859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:43.154026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:43.213988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:43.239220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 537/1057] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:43.328799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dade2-96c6-402c-9fe5-78b32bd898cb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.360579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:43.473035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028dade2-96c6-402c-9fe5-78b32bd898cb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:43.509471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.522791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:43.523798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.524078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.524631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.525229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:43.526845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:43.538142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:43.539254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:43.544346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 521/1058] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:43.546652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.646802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:43.651271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cfb6-f840-4d22-9b5f-f915b2337162 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:43.668596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e32f5-05f0-474d-af97-08e2dc5b47a8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:43.694017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:43.694661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.694937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.695313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.706563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:43.711467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:43.712426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:43.713267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 538/1059] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:43.718760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.725091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:43.725521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.733440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.733440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.733440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] RBAC: Adding query filter params (name=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:43.733440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:43.733440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:43.738795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 522/1060] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:43.745191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.783258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:43.862316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c624ec8-a403-4436-b492-70797abe9899 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:43.868360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d52cf0-d5ed-49be-b0cc-1fe8be5dbd85 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:43.904708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:43.905310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.905638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.905855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.906526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:43.906828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:43.907423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:43.908045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:43.908248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:43.908343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:43.908579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:43.909207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] RBAC: Adding query filter params (type=image) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:43.909517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:43.910881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:43.916006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 523/1061] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:43.918747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 539/1062] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:43.921936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.924195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:43.939075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:44.056013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012b87a-ad2e-47fb-896b-2d4c4370a5b5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.058583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:44.069869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166a998-e4bb-4129-8aa6-70de0e885f6b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.096964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.097607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.097883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.098153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.109548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.111028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.111578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.112147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.112422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.112685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.113355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.114733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:44.129198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:44.131133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:44.132306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:44.132306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:44.132306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:44.132306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 540/1063] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:44.136499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:44.141259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 524/1064] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:01:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:44.275296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003a81-4c91-4fd3-b918-e8dbd79aff82 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.341262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.342148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.342569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.343033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.344106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:44.344619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.346967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.361306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 541/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:44.367036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:44.439906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:44.479802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d5a0f-ff05-4cda-9df3-18ec5cb326a0 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.518571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.519556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.519940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.520372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.533515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.536275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-6102510a-672f-463d-b6e9-63751c9873c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:44.556353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:44.557597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:44.558753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:44.562558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 525/1066] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:01:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:44.563505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:44.563934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271450be-f40a-4d67-b4b7-21f82537bbe6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.564484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271450be-f40a-4d67-b4b7-21f82537bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.564484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271450be-f40a-4d67-b4b7-21f82537bbe6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.566632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 526/1067] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:44.572608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.572971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.573247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.579497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:44.592808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:44.593948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:44.686659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 527/1068] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:44.691015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7a57-7474-4771-ad9e-54365d0c180e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.745914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.746626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.746963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.747406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.748199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:44.748568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.750061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.775882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 542/1069] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:01:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:44.777685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:44.839967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:44.888079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8292-420f-4d97-bdf4-37c8c03dcfc8 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:44.924736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:44.925533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:44.925931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:44.926297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:44.937082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:44.938663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:44.953586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:44.954735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:44.955895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:44.955895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:44.955895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:44.957048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 528/1070] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:44.966303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.035088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.055629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.096586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9b1b-e5fa-4922-82e2-e15d20be001a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.137328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.138274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.138660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.139135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.140324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:45.140866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.143347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.153303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d91c5-a282-4e1a-90c6-e8e567fdf2e5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.159909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 543/1071] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:45.164056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.165620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.194326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.194953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.195257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.195555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.207268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:45.212521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:45.213533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:45.214375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:45.215527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 529/1072] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:45.220101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.288526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0f38b-d119-4939-a91f-dda90d0491f6 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.319895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.332792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.333431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.333716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.333992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.339958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debdc14-74e7-4931-b001-197d7a2262ad None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.341181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.342638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:45.354557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:45.355560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:45.356533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 544/1073] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:45.361732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.381091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.381705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.381981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.382255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.382923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:45.383257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.384629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.393933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 530/1074] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:45.399728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.432876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.483655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc10d8-6b39-4d40-91a0-9161d254707b None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.516975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5956f22-69d9-4315-a5af-e489122ffb1e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.536943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.537878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.538328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.538656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.539495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:45.539865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.541452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.554285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.554926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.555227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.555499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] PATH_INFO: `/v3/users/7749be1159614f879156e6dd87247914` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.556631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] RBAC: Authorizing `identity:get_user(user_id=7749be1159614f879156e6dd87247914)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.558104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.559953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 531/1075] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/users/7749be1159614f879156e6dd87247914 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:45.567168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 545/1076] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:45.567368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.568280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.641063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.694960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:45.700835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76385-95b9-426c-996e-1e3b51abaaff None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.706146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c11f-3de2-4b67-95af-48718edd4c6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.753388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.753695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.754045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.754321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.754514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.754630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.754902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.755264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/707a08c96c504a1599c1596c731f72bd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.755767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.757222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.757723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=acc4c0a07dfa4d738ce279cafb5fd3e0, role_id=707a08c96c504a1599c1596c731f72bd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.759059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 532/1077] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:01:45 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:45.759308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24ac1c-c3a5-42b5-9202-8863a147b33c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.765168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:45.784831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 546/1078] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:45 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/acc4c0a07dfa4d738ce279cafb5fd3e0/roles/707a08c96c504a1599c1596c731f72bd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:01:45.901141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaba7-70f8-476c-8154-29ac7b9f6e2a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:45.953965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:45.954902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:45.955375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:45.955818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896/users/7749be1159614f879156e6dd87247914/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:45.958004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] RBAC: Authorizing `identity:create_grant(project_id=09c6e9b9e4424d929f2480d7521f1896, user_id=7749be1159614f879156e6dd87247914, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:45.959533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0b88d-d3a3-4a64-90a8-3093f3e76046 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:45.978793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 533/1079] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:45 2022] PUT /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896/users/7749be1159614f879156e6dd87247914/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:01:46.144405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019c2f-1596-4371-a510-b8c1c833279d None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:46.144708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019c2f-1596-4371-a510-b8c1c833279d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:46.144938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1019c2f-1596-4371-a510-b8c1c833279d None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:46.146353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 547/1080] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:46.152374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:46.153023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:46.153274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:46.177814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:46.178020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:46.207286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:46.265078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 534/1081] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:46.530224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019c2f-1596-4371-a510-b8c1c833279d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:46.658479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1019c2f-1596-4371-a510-b8c1c833279d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:46.669367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:46.699094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:46.699732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:46.700013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:46.700283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:46.787852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:46.789341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:46.907250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 548/1082] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:46.911135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:47.040872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49909510-12ec-47e6-b960-8f8753300d95 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:47.082901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:47.083584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.083859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.084131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.095306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:47.096770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-77b15cb7-6dee-4e32-9388-f1e88542a584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:47.112224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:47.113247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:47.120007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:47.120007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:47.120007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:47.120007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 535/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:47.120589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:47.131126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:47.233523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dabd3-f097-492a-92f5-d32aa1ae1104 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:47.274002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:47.274267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.274498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.274656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.275338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:47.275641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:47.277085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d77f-011b-422b-93b3-fcccc911224a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:47.295323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 549/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:47.764958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3ab5-5b5c-48b0-8ef8-bc725e4045c6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.765295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3ab5-5b5c-48b0-8ef8-bc725e4045c6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.765483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad3ab5-5b5c-48b0-8ef8-bc725e4045c6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.767000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 536/1085] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:47.772950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74dcb4-822a-4f5c-a166-30306281a442 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.773593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74dcb4-822a-4f5c-a166-30306281a442 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.773593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74dcb4-822a-4f5c-a166-30306281a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.797091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5f74dcb4-822a-4f5c-a166-30306281a442 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:47.798308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5f74dcb4-822a-4f5c-a166-30306281a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:47.873140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:47.886483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 550/1086] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:47.900059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e4e9-1c7c-4fdf-aad3-286c299552c5 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.900349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e4e9-1c7c-4fdf-aad3-286c299552c5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.900585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e4e9-1c7c-4fdf-aad3-286c299552c5 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.902230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 537/1087] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:47.908186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:47.908473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:47.908747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:47.928237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:47.929467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:48.006514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 551/1088] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:48.152577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e4e9-1c7c-4fdf-aad3-286c299552c5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.165214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.269323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.270216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e4e9-1c7c-4fdf-aad3-286c299552c5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.305593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.306239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.306516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.306790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.318241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:48.323500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:48.324855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 13:01:48.326589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:48.329989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 538/1089] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:48.330599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.376018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c483d26-0862-4db8-a512-5d3b7da2736e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.403390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.406381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.419907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.420677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.420962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.421234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.432658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:01:48.437478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:48.438602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:48.439492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 552/1090] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:48.444843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.456641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06eee6-9576-4b2d-9e04-44a71ba3bb5b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.493339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.493962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.494242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.494516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.495245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:48.495576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.496980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:48.506044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 539/1091] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:48.512204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.551649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54eba-eec9-4726-9db9-458eec313e4c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.587029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.587667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.587944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.588207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.588891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:48.589185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.590825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:48.600014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 553/1092] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:48.606082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.625570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb0d4-fca5-4d85-881e-755e157aa45a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.657381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.665718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.666376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.666681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.666952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.669196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.679657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.681172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:48.696260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:48.697429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:48.698309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:48.698309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:48.698309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:48.698309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 540/1093] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:48.703704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.727092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96de41-de8c-47b7-ba03-2fd42fd2abe9 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.766838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.767508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.767782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.768052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] PATH_INFO: `/v3/users/7749be1159614f879156e6dd87247914` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.769204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] RBAC: Authorizing `identity:get_user(user_id=7749be1159614f879156e6dd87247914)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.770642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:48.772286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 554/1094] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/users/7749be1159614f879156e6dd87247914 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:48.779011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.820599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c1fad-d492-45f5-a106-78ff66aa127f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.864965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.865589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.865873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.866145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.866792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:48.867095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.868577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:48.882249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 541/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:48.888153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:48.888864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84b6a-dd39-466a-849d-d2479a5b15bc None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:48.907061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.925515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:48.926042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:48.926313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:48.926583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:48.939111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:48.996440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:48.997904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.004329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839bc8-b542-4721-aefc-d48fba407d8b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.042204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.042849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.043205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.043497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.051215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.052696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:01:49.066272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:49.073385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 542/1096] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:01:49.075040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.101998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 555/1097] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 13:01:49.108278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.131775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:49.203525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3de9-1fd0-4b10-b9b6-e73c681a49d8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.205161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:49.226140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8b57-85c4-4806-9671-ce7083bb8c45 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.241737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.242359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.242639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.242911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.245791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:49.245791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.245791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.265209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 543/1098] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:49.267348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.267988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.268260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.268530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.269658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.271197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.271385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.276390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 556/1099] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:49.279947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.373014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:49.382601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce3577-daee-4490-9576-6c27a79fed97 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.392582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a0617-924d-4ba7-ac33-946294093864 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.421034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.421661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.422008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.422201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.434693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.435392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.435652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.435922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.436657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=09c6e9b9e4424d929f2480d7521f1896, user.id=7749be1159614f879156e6dd87247914) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:49.436967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.438402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.444771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 557/1100] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/role_assignments?user.id=7749be1159614f879156e6dd87247914&scope.project.id=09c6e9b9e4424d929f2480d7521f1896&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:49.465267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:49.512320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.513816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.639831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 544/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 13:01:49.645959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.759351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8b95-8ab8-4020-9b9d-2e449d202469 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.795448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.796110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.796370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.799356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.809075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.810546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:01:49.826389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:49.827573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:01:49.828483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:01:49.828483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:01:49.828483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:49.828483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 558/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:49.834056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:49.899104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:49.947023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e8e-cd39-4ec0-b540-0e251b4dcaee None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:49.983899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:49.984519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:49.984790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:49.985060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:49.985708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:49.986008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:49.987425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:49.999574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 545/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:50.005348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:50.008430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:50.111951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2c62-3cf9-4b7a-b734-63ed5e0cbd6c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:50.148591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:50.149261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:50.149536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:50.149805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:50.157406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:50.158859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:01:50.170600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:01:50.171734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:01:50.172627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 559/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:01:50.177889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:50.285629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813d2f-2279-4228-be52-d76707ee1b8d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:50.307074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:50.322412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:50.323048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:50.323341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:50.323613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:50.324324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:50.324639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:50.326089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b58759-ad42-4336-97fb-68a59fe5ec8f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:50.339990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 546/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:50.346419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:50.426177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:50.468496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1b652-d3aa-4251-8493-4409944b7c1a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:50.503894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:50.504519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:50.504798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:50.505080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:50.505808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] RBAC: Adding query filter params (role.id=707a08c96c504a1599c1596c731f72bd, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=acc4c0a07dfa4d738ce279cafb5fd3e0) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:50.506120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:50.507665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45820-639c-4f14-8280-44543884fe30 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:50.514282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 560/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:50 2022] GET /identity/v3/role_assignments?user.id=acc4c0a07dfa4d738ce279cafb5fd3e0&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=707a08c96c504a1599c1596c731f72bd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:51.410747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe87f-831c-4181-9de3-f6a2354f3e24 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:51.411294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe87f-831c-4181-9de3-f6a2354f3e24 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:51.411404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fe87f-831c-4181-9de3-f6a2354f3e24 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:51.412720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 547/1107] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:51.418756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:51.419295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:51.419295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:51.439393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:51.440559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:51.512781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 561/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:51.780555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fe87f-831c-4181-9de3-f6a2354f3e24 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:51.891126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fe87f-831c-4181-9de3-f6a2354f3e24 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:51.929389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:51.930024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:51.930302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:51.930577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:51.931759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:51.933264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e95c-7bf4-4131-94e2-44691d105998 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:51.934867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 548/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:51.941065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:52.006345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:52.055760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf61cd-d5b7-4293-8ccc-5eb1560fb8d5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:52.092195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:52.092877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:52.093155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:52.093428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:52.094090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:52.095699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72bb41-1e2b-4ebf-b083-b49681208716 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:52.119022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 562/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:01:51 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:01:54.069268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da99f2-be31-4b79-a7be-969b693e5317 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:54.069834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da99f2-be31-4b79-a7be-969b693e5317 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:54.069834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da99f2-be31-4b79-a7be-969b693e5317 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:54.071170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 549/1111] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:54.076762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:54.077227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:54.077318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:54.098366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:54.099692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:54.173095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 563/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:54.439313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da99f2-be31-4b79-a7be-969b693e5317 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:54.494700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:54.554950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da99f2-be31-4b79-a7be-969b693e5317 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:54.590407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:54.591054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:54.591340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:54.591617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] PATH_INFO: `/v3/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:54.593017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] RBAC: Authorizing `identity:get_role(role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:54.594412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:54.595810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 550/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:54 2022] GET /identity/v3/roles/56a6a91609874159a6cf397498dea0cd => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:54.601884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:54.650712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:54.717227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0b600-13dc-4391-a9dd-d02d70bcddb2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:54.754307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:54.754952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:54.755217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:54.755527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] PATH_INFO: `/v3/users/4f14d05effc041c1ad20899a3880f10a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:54.771133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f14d05effc041c1ad20899a3880f10a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:54.772627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:54.774326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 564/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:54 2022] GET /identity/v3/users/4f14d05effc041c1ad20899a3880f10a => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:01:54.781548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:54.898906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25723421-35a9-4056-af6f-dd80d9b15620 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:54.922851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:54.943310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:54.943925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:54.944199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:54.944464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:55.021332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:55.022812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:55.130375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 551/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:01:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:01:55.136765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:55.236424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:55.239576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496e71-23dd-4c3b-b382-c59e0e885ce8 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:55.274625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:55.275171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:55.275551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:55.275856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:55.277196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:55.279063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578e05-9bb6-4b24-87bb-feb9c817c24a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:55.280715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 565/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:01:55 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:55.287209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:55.307489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:55.396847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17329ce-03e4-40a5-8c2a-4700e11a056f None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:55.435323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:55.435939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:55.436231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:55.436479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:55.437214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=09c6e9b9e4424d929f2480d7521f1896, user.id=4f14d05effc041c1ad20899a3880f10a) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:01:55.437518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:55.438960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb55803-8c36-42fe-8681-479c311cf427 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:55.445080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 552/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:01:55 2022] GET /identity/v3/role_assignments?user.id=4f14d05effc041c1ad20899a3880f10a&scope.project.id=09c6e9b9e4424d929f2480d7521f1896&role.id=56a6a91609874159a6cf397498dea0cd => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:57.328468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a00-de96-435b-a452-49aafa1bd2cf None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:57.329073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a00-de96-435b-a452-49aafa1bd2cf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:57.329073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9a00-de96-435b-a452-49aafa1bd2cf None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:57.330341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 566/1118] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:01:57.335866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:57.336357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:57.336357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:57.360181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:01:57.361423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:01:57.433787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 553/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:01:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:01:57.703729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9a00-de96-435b-a452-49aafa1bd2cf None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:57.804477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9a00-de96-435b-a452-49aafa1bd2cf None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:57.840421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:57.841052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:57.841318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:57.841585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] PATH_INFO: `/v3/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:57.842970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] RBAC: Authorizing `identity:get_role(role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:57.844379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:57.845685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 567/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:57 2022] GET /identity/v3/roles/56a6a91609874159a6cf397498dea0cd => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:57.852146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:57.865303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:57.961919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912806ef-c176-41f6-ac48-f4bcbc2ee44c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:57.997812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:57.998452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:57.998731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:57.999008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] PATH_INFO: `/v3/users/4f14d05effc041c1ad20899a3880f10a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:58.000333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] RBAC: Authorizing `identity:get_user(user_id=4f14d05effc041c1ad20899a3880f10a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:58.001801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:58.003461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 554/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:01:57 2022] GET /identity/v3/users/4f14d05effc041c1ad20899a3880f10a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:58.009591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:58.047747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:58.125306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d76bb-7288-4930-a051-7735ecc84d0a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:58.165235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:58.165870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:58.166175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:58.166452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:58.167621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:58.169060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999443ed-8b2f-4813-9d13-6bd3c95fde4e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:58.170712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 568/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:01:58 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:01:58.177077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:01:58.274631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:01:58.300153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128ec8-d79a-47f4-bc9d-f70ec4d9be7b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:01:58.344834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:01:58.345569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:01:58.345735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:01:58.345998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896/users/4f14d05effc041c1ad20899a3880f10a/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:01:58.348208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] RBAC: Authorizing `identity:create_grant(project_id=09c6e9b9e4424d929f2480d7521f1896, user_id=4f14d05effc041c1ad20899a3880f10a, role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:01:58.349706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d797bc-297a-4d18-b0c3-ecfdc3ddb19e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:01:58.365199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 555/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:01:58 2022] PUT /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896/users/4f14d05effc041c1ad20899a3880f10a/roles/56a6a91609874159a6cf397498dea0cd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:02:00.248174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870394-d186-4744-b26c-ee70da68bb0b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:00.248721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870394-d186-4744-b26c-ee70da68bb0b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:00.248721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d870394-d186-4744-b26c-ee70da68bb0b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:00.250061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 569/1124] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:00.255902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:00.256310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:00.256471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:00.278180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:00.279451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:00.352308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 556/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:00.615635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d870394-d186-4744-b26c-ee70da68bb0b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:00.724584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d870394-d186-4744-b26c-ee70da68bb0b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:00.727036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:00.761665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:00.762309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:00.762581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:00.762848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] PATH_INFO: `/v3/roles/56a6a91609874159a6cf397498dea0cd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:00.764266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] RBAC: Authorizing `identity:get_role(role_id=56a6a91609874159a6cf397498dea0cd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:00.765633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:00.766957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 570/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:00 2022] GET /identity/v3/roles/56a6a91609874159a6cf397498dea0cd => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:00.773117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:00.843175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:00.886177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d580-5b8d-478b-9f86-b108f5c0217a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:00.922810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:00.923473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:00.923745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:00.924013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] PATH_INFO: `/v3/users/4f14d05effc041c1ad20899a3880f10a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:00.925180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] RBAC: Authorizing `identity:get_user(user_id=4f14d05effc041c1ad20899a3880f10a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:00.926629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:00.928275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 557/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:00 2022] GET /identity/v3/users/4f14d05effc041c1ad20899a3880f10a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:00.934468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:01.046942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd05814-551b-42a3-806c-1e40fe5556c7 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:01.084447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:01.085237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:01.085719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:01.086042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:01.129272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:01.159091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:01.160510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:01.262323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 571/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:02:01.269862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:01.377059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7df0-8560-48d8-8feb-d23bae4a6453 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:01.421509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:01.422053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:01.422332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:01.422604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] PATH_INFO: `/v3/projects/09c6e9b9e4424d929f2480d7521f1896` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:01.423797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] RBAC: Authorizing `identity:get_project(project_id=09c6e9b9e4424d929f2480d7521f1896)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:01.425254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4cb0-53ea-4b18-9f1e-a0919dc679b6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:01.426916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 558/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:01 2022] GET /identity/v3/projects/09c6e9b9e4424d929f2480d7521f1896 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:01.433521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:01.507091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:01.541293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d357a-f028-4437-a530-ce571781b924 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:01.585436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:01.586042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:01.586300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:01.586588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:01.587348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] RBAC: Adding query filter params (role.id=56a6a91609874159a6cf397498dea0cd, scope.project.id=09c6e9b9e4424d929f2480d7521f1896, user.id=4f14d05effc041c1ad20899a3880f10a) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:01.587652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:01.589193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b23eae-251a-4214-9624-72b1d487a921 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:01.595626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 572/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:02:01 2022] GET /identity/v3/role_assignments?user.id=4f14d05effc041c1ad20899a3880f10a&scope.project.id=09c6e9b9e4424d929f2480d7521f1896&role.id=56a6a91609874159a6cf397498dea0cd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:03.525617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c93-191a-4d7b-a805-ce4134ad9953 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:03.526216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c93-191a-4d7b-a805-ce4134ad9953 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:03.526216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3354c93-191a-4d7b-a805-ce4134ad9953 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:03.527896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 559/1131] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:03.533716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:03.534224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:03.534224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:03.553428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:03.554603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:03.629380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 573/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:03.894277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3354c93-191a-4d7b-a805-ce4134ad9953 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:03.898496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:04.012006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3354c93-191a-4d7b-a805-ce4134ad9953 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:04.062583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:04.063248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:04.063529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:04.063800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:04.064942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:04.066399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60014ed0-e66c-40ef-808c-46ef7ce33623 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:04.068016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 560/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:04.074254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:04.154214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:04.205537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5681cb-d4a8-4db4-b111-222760117d86 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:04.243349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c89e60-257a-49bb-811e-de215681686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:04.243966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89e60-257a-49bb-811e-de215681686b None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:04.244278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89e60-257a-49bb-811e-de215681686b None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:04.244549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c89e60-257a-49bb-811e-de215681686b None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:04.245205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c89e60-257a-49bb-811e-de215681686b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:04.246645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c89e60-257a-49bb-811e-de215681686b None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:04.277052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 574/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:02:04 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:02:06.197699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0e3f-2be8-4bf2-9536-e5a57db7c341 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:06.198269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0e3f-2be8-4bf2-9536-e5a57db7c341 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:06.198269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0e3f-2be8-4bf2-9536-e5a57db7c341 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:06.199640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 561/1135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:06.205176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:06.205661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:06.205661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:06.225007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:06.226213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:06.301280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 575/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:06.564004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb0e3f-2be8-4bf2-9536-e5a57db7c341 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:06.641713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:06.674528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb0e3f-2be8-4bf2-9536-e5a57db7c341 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:06.717502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:06.718161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:06.718561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:06.718693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:06.719878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:06.721348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d023ef-c5fd-4ff5-a0ea-0167195ea631 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:06.722944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 562/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:06.728959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:06.782817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:06.856833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0a60f-5788-4fe2-8a5f-aec97e04bf61 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:06.902097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:06.903064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:06.903385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:06.903661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:06.904327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:06.905787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cf60-2a3e-4eac-ad76-7fce9054bc7c None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:06.933335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 576/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:02:06 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:02:08.920881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360dc8-d4f6-48a8-8b54-2b7fb7afc171 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:08.921431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360dc8-d4f6-48a8-8b54-2b7fb7afc171 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:08.921431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360dc8-d4f6-48a8-8b54-2b7fb7afc171 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:08.922674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 563/1139] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:08.928027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:08.928480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:08.928621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:08.948161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:08.949571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:09.046401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 577/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:09.313056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360dc8-d4f6-48a8-8b54-2b7fb7afc171 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:09.424307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360dc8-d4f6-48a8-8b54-2b7fb7afc171 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:09.461367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:09.461991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:09.462265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:09.462534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:09.474786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:09.478133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:09.483247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:09.484232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:09.485087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 564/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:09.490789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:09.530536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:09.608423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb26e9a-dcdd-433b-a812-2153df901481 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:09.646377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:09.646994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:09.647301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:09.647572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:09.648248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:09.648550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:09.649926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:09.659049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 578/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:09.666230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:09.771526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f476-a03d-468a-b0f3-15b63e664167 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:09.807221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:09.807879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:09.808156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:09.808424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] PATH_INFO: `/v3/users/5d49b10d47734426b244cb04e138089f` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:09.822829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] RBAC: Authorizing `identity:get_user(user_id=5d49b10d47734426b244cb04e138089f)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:09.824327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:09.826026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 565/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:09 2022] GET /identity/v3/users/5d49b10d47734426b244cb04e138089f => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:09.832147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:09.942223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:09.948360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c5de-31fa-4641-abe8-7834117cb4ae None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:09.983740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:09.984350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:09.984644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:09.984901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:10.058512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:10.060016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:10.166085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:10.178262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 579/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:02:10.184490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:10.243843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:10.291852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8807a5-a61e-470b-acd3-c7f4dc55fea8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:10.329281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:10.329902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:10.330183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:10.330457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] PATH_INFO: `/v3/projects/752a784044884d7da3a2da1298dd933c` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:10.331652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] RBAC: Authorizing `identity:get_project(project_id=752a784044884d7da3a2da1298dd933c)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:10.333283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660da82-91b8-4941-8b45-192a9fe38d88 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:10.335328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 566/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:10 2022] GET /identity/v3/projects/752a784044884d7da3a2da1298dd933c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:10.342720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:10.454865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf228-ce58-42b1-8b95-220c38fa1037 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:10.493067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:10.493671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:10.494058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:10.494268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:10.494994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=752a784044884d7da3a2da1298dd933c, user.id=5d49b10d47734426b244cb04e138089f) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:10.495330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:10.496773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c5b5-f37a-40ab-bcc1-fa9d1ec4f1d8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:10.502675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 580/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:02:10 2022] GET /identity/v3/role_assignments?user.id=5d49b10d47734426b244cb04e138089f&scope.project.id=752a784044884d7da3a2da1298dd933c&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:02:12.383696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c602c-4b56-41fb-ad76-4b211f8c94e7 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:12.384577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c602c-4b56-41fb-ad76-4b211f8c94e7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:12.384577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c602c-4b56-41fb-ad76-4b211f8c94e7 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:12.385638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 567/1147] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:12.391584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:12.392091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:12.392091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:12.412168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:12.413405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:12.476937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:12.489770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 581/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:12.755452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c602c-4b56-41fb-ad76-4b211f8c94e7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:12.873028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c602c-4b56-41fb-ad76-4b211f8c94e7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:12.901607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:12.915471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:12.916149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:12.916457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:12.916727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:12.927380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:12.932280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:12.933400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:12.934397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:12.938546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 568/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:12.939808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:13.049264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975385-b829-40c2-b424-9ccc175727c2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:13.087627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:13.088241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:13.088513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:13.088752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:13.089424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:13.089722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:13.091261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:13.100635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 582/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:13.106978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:13.220777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91481a-c223-408f-8a9b-ee144891b5d3 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:13.257085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:13.257730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:13.258001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:13.258268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] PATH_INFO: `/v3/users/5d49b10d47734426b244cb04e138089f` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:13.259563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] RBAC: Authorizing `identity:get_user(user_id=5d49b10d47734426b244cb04e138089f)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:13.261015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:13.262624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 569/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:13 2022] GET /identity/v3/users/5d49b10d47734426b244cb04e138089f => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:02:13.268779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:13.334733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:13.388564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dcff9-0774-453c-97ce-e7b2e51fe1ac None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:13.423696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:13.424418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:13.424600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:13.424871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] PATH_INFO: `/v3/projects/752a784044884d7da3a2da1298dd933c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:13.425992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] RBAC: Authorizing `identity:get_project(project_id=752a784044884d7da3a2da1298dd933c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:13.429322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2c9d-fc01-4a45-8c32-bc96c3aeead9 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:13.429322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 583/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:13 2022] GET /identity/v3/projects/752a784044884d7da3a2da1298dd933c => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:13.435552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:13.497188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:13.550633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d617a-6e9f-45e1-bd41-072410822828 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:13.588628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:13.589198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:13.589474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:13.589745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] PATH_INFO: `/v3/projects/752a784044884d7da3a2da1298dd933c/users/5d49b10d47734426b244cb04e138089f/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:13.591795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] RBAC: Authorizing `identity:create_grant(project_id=752a784044884d7da3a2da1298dd933c, user_id=5d49b10d47734426b244cb04e138089f, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:13.593295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267920b-6851-4343-ba93-a8378ca97659 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:13.616641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 570/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:02:13 2022] PUT /identity/v3/projects/752a784044884d7da3a2da1298dd933c/users/5d49b10d47734426b244cb04e138089f/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:02:15.512594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7daf35-11c1-4c69-913b-685dbcc25570 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:15.513147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7daf35-11c1-4c69-913b-685dbcc25570 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:15.513147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7daf35-11c1-4c69-913b-685dbcc25570 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:15.514493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 584/1154] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:15.520078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:15.520510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:15.520629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:15.539850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:15.541153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:15.619955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 571/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:15.886065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7daf35-11c1-4c69-913b-685dbcc25570 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.011795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7daf35-11c1-4c69-913b-685dbcc25570 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:16.034082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:16.049237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:16.049875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:16.050155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:16.050426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:16.061154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:16.065961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:16.067373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:02:16.068476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 585/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:16.073524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.122155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:16.180470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0934-6258-4256-b473-b31772e5c2a4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:16.216086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:16.216700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:16.216974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:16.217243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:16.217916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:16.218215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:16.219642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:16.228382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 572/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:16.234429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.348516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322a67-18ed-4714-901c-3445b1833c9a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:16.383508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:16.384155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:16.384437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:16.384712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] PATH_INFO: `/v3/users/5d49b10d47734426b244cb04e138089f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:16.385967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] RBAC: Authorizing `identity:get_user(user_id=5d49b10d47734426b244cb04e138089f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:16.387460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:16.389091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 586/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:16 2022] GET /identity/v3/users/5d49b10d47734426b244cb04e138089f => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:16.395358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.517479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1973b6d-a09c-46e8-8ca1-7826ab32c6ce None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:16.525296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:16.557320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:16.557917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:16.558169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:16.558466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:16.638427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:16.639928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:16.750308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 573/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:02:16.756663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.810325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:16.868789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2cf61-0fce-4981-b312-f8b5a9e2cb83 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:16.906216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:16.906848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:16.907122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:16.907424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] PATH_INFO: `/v3/projects/752a784044884d7da3a2da1298dd933c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:16.908632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=752a784044884d7da3a2da1298dd933c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:16.910059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8848de-cb36-4e07-a514-046f39cb8ad8 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:16.911751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 587/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:16 2022] GET /identity/v3/projects/752a784044884d7da3a2da1298dd933c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:16.918221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:16.926999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:17.034245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11057-ca48-4a7d-8e1f-fed41f018443 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:17.069793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:17.070309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:17.070589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:17.070859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:17.071620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=752a784044884d7da3a2da1298dd933c, user.id=5d49b10d47734426b244cb04e138089f) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:17.071972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:17.073426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8b51-0221-4029-b939-16e42c0972bf None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:17.079825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 574/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:02:16 2022] GET /identity/v3/role_assignments?user.id=5d49b10d47734426b244cb04e138089f&scope.project.id=752a784044884d7da3a2da1298dd933c&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:19.013122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcff7-ee4a-42d3-96fd-3592b817b532 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:19.013753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcff7-ee4a-42d3-96fd-3592b817b532 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:19.013753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcff7-ee4a-42d3-96fd-3592b817b532 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:19.014988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 588/1162] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:19.020861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:19.021352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:19.021612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:19.041730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:19.042960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:19.125134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:19.130682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 575/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:19.390580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedcff7-ee4a-42d3-96fd-3592b817b532 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:19.496831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedcff7-ee4a-42d3-96fd-3592b817b532 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:19.515012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:19.533829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:19.534439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:19.534718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:19.534985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:19.605802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:19.607617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:19.712054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 589/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:02:19.718721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:19.829674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82c16b-4bdd-4b70-9fcb-89279eb347c0 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:19.867945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:19.868636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:19.868932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:19.869170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:19.876821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:19.878289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-0975aa36-1bfb-4b50-b03d-628a55424d2d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:19.890361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:19.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:19.892560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 576/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:02:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:19.897971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:19.924640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:20.012740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d382-b9f6-45cf-9b57-13a85409453e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:20.052485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:20.053192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:20.053366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:20.053637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:20.054294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:20.054597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:20.056021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc97df-d158-4488-a924-757b3ffeb1ba None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:20.063677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 590/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 13:02:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:21.954825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daca19-8b12-4d81-b8ea-e8cd6254a7bb None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:21.955359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daca19-8b12-4d81-b8ea-e8cd6254a7bb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:21.955359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daca19-8b12-4d81-b8ea-e8cd6254a7bb None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:21.956683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 577/1167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:21.963133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3419f-2e62-4d1a-8674-7d4ddf31f8af None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:21.963691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3419f-2e62-4d1a-8674-7d4ddf31f8af None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:21.963813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3419f-2e62-4d1a-8674-7d4ddf31f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:21.984811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5da3419f-2e62-4d1a-8674-7d4ddf31f8af None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:21.986042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5da3419f-2e62-4d1a-8674-7d4ddf31f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:22.064708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 591/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:22.327798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daca19-8b12-4d81-b8ea-e8cd6254a7bb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:22.395466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:22.441857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daca19-8b12-4d81-b8ea-e8cd6254a7bb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:22.476816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:22.477429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:22.477705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:22.478013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:22.478681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:22.480092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cf75f-8a2b-4160-83f8-ca28cdacaec3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:22.504300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 578/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Aug 24 13:02:22 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:02:24.448535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f316c6-b015-4877-8b0d-15ee83574343 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:24.449117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f316c6-b015-4877-8b0d-15ee83574343 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:24.449117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f316c6-b015-4877-8b0d-15ee83574343 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:24.450433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 592/1170] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:24.456360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:24.456895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:24.456895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:24.478734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:24.478734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:24.553998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 579/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:02:24.821669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f316c6-b015-4877-8b0d-15ee83574343 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:24.835083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:24.927561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f316c6-b015-4877-8b0d-15ee83574343 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:24.964851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:24.965488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:24.965762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:24.966033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] PATH_INFO: `/v3/domains/1ac533e7475249fe9575ef8c75f007a6` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:24.978758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1ac533e7475249fe9575ef8c75f007a6)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:24.980246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005acd5-f82c-4ab2-a2d2-22eed0c61ae0 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:24.981938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 593/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 24 13:02:24 2022] GET /identity/v3/domains/1ac533e7475249fe9575ef8c75f007a6 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:24.989419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:25.057813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:25.117458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671894-6fe1-4cbb-9c84-2bf295307aff None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:25.154245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:25.154860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:25.155131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:25.155426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:25.156107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:25.157573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752ed8a-b2de-4572-a84d-e4b0ff88b279 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:25.188062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 580/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:02:24 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:02:27.134469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f50f-06d2-4ddf-9d27-2dc8b08f8265 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:27.135018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f50f-06d2-4ddf-9d27-2dc8b08f8265 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:27.135018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f50f-06d2-4ddf-9d27-2dc8b08f8265 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:27.136445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 594/1174] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:27.142217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:27.142700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:27.142804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:27.164248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:27.165505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:27.240976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 581/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:27.523407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f50f-06d2-4ddf-9d27-2dc8b08f8265 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:27.608940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:27.648036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f50f-06d2-4ddf-9d27-2dc8b08f8265 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:27.699617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:27.700261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:27.700558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:27.700830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] PATH_INFO: `/v3/domains/1ac533e7475249fe9575ef8c75f007a6` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:27.702065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1ac533e7475249fe9575ef8c75f007a6)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:27.703530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11369b-4e9e-4459-9b3f-58f9563ca997 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:27.705116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 595/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 24 13:02:27 2022] GET /identity/v3/domains/1ac533e7475249fe9575ef8c75f007a6 => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:27.714055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:27.761565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:27.846913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2236fc-2b4c-4a91-a1bb-9192cf29563c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:27.902019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:27.902996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:27.903312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:27.903574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:27.904239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:27.905723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de8fb8-c9d7-4f7f-ac5e-77791fa72a9d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:27.929392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 582/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:02:27 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:02:29.905979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84729a-3177-4117-8b25-6fa65dc949df None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:29.906516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84729a-3177-4117-8b25-6fa65dc949df None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:29.906516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84729a-3177-4117-8b25-6fa65dc949df None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:29.907837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 596/1178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:29.913849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c588-d637-4773-852d-f3ca2945008f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:29.914389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c588-d637-4773-852d-f3ca2945008f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:29.914389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c588-d637-4773-852d-f3ca2945008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:29.933327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0222c588-d637-4773-852d-f3ca2945008f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:29.934562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0222c588-d637-4773-852d-f3ca2945008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:30.005688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 583/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:30.276588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84729a-3177-4117-8b25-6fa65dc949df None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:30.392855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84729a-3177-4117-8b25-6fa65dc949df None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:30.439664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:30.440299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:30.440572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:30.440836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:30.449034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:30.453965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:30.458971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:30.460046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:02:30.460902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 597/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:30.467862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c588-d637-4773-852d-f3ca2945008f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:30.491818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:30.584581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c588-d637-4773-852d-f3ca2945008f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:30.620301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38478-730a-4463-8821-b84610be9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:30.620934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38478-730a-4463-8821-b84610be9dac None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:30.621211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38478-730a-4463-8821-b84610be9dac None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:30.621483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38478-730a-4463-8821-b84610be9dac None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:30.622160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38478-730a-4463-8821-b84610be9dac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:30.622461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38478-730a-4463-8821-b84610be9dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:30.623885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38478-730a-4463-8821-b84610be9dac None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:30.632710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 584/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:30.638930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:30.750180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4381-464f-4396-8aa4-55d76ba99d9c None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:30.789340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:30.789981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:30.790258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:30.790530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] PATH_INFO: `/v3/users/a39595925cc74fe094c746c3fef83118` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:30.805405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] RBAC: Authorizing `identity:get_user(user_id=a39595925cc74fe094c746c3fef83118)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:30.806867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:30.808718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 598/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:30 2022] GET /identity/v3/users/a39595925cc74fe094c746c3fef83118 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:30.814999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38478-730a-4463-8821-b84610be9dac None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:30.903797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:30.926211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38478-730a-4463-8821-b84610be9dac None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:30.962825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:30.963510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:30.963790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:30.964061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:31.036022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:31.037487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:31.117676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:31.139249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 585/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 13:02:31.145743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:31.209926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:31.255573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e46dc-83e9-47d5-a31f-95a8ef7fd80f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:31.292433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:31.293072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:31.293345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:31.293615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] PATH_INFO: `/v3/projects/05add8b3a5ae44569d9919b39e960205` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:31.294748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] RBAC: Authorizing `identity:get_project(project_id=05add8b3a5ae44569d9919b39e960205)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:31.296227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43588f-5c82-4f6d-a1c7-053218bbe437 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:31.297900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 599/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:31 2022] GET /identity/v3/projects/05add8b3a5ae44569d9919b39e960205 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:31.305143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:31.416045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4a918-e634-4e97-a9d3-096a028391c6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:31.452183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:31.452772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:31.453045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:31.453313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:31.454034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=05add8b3a5ae44569d9919b39e960205, user.id=a39595925cc74fe094c746c3fef83118) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:31.454337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:31.455852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a300da-18ed-43c1-8759-445e742c562e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:31.461561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 586/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:02:31 2022] GET /identity/v3/role_assignments?user.id=a39595925cc74fe094c746c3fef83118&scope.project.id=05add8b3a5ae44569d9919b39e960205&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:33.344224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc335-84f3-4d0c-926e-519dd356993f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:33.344820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc335-84f3-4d0c-926e-519dd356993f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:33.344820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc335-84f3-4d0c-926e-519dd356993f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:33.346116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 600/1186] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:33.353412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:33.353944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:33.353944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:33.374574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:33.375831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:33.421326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:33.450886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 587/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:33.713945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc335-84f3-4d0c-926e-519dd356993f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:33.824635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc335-84f3-4d0c-926e-519dd356993f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:33.849169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:33.860695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:33.861323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:33.861605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:33.861871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:33.876207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:33.881009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:33.882373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:02:33.883988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 601/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:33.888734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:33.995705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b394-4fb4-43c4-9092-15b67ff4fd6c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:34.033674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:34.034294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:34.034571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:34.034840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:34.035547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:34.035847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:34.037244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:34.046482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 588/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:34.052466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:34.162655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be04641-772c-4ad1-8474-321ac4aadc08 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:34.205272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:34.205924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:34.206194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:34.206462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] PATH_INFO: `/v3/users/a39595925cc74fe094c746c3fef83118` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:34.207647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=a39595925cc74fe094c746c3fef83118)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:34.209101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:34.210719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 602/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:34 2022] GET /identity/v3/users/a39595925cc74fe094c746c3fef83118 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:34.216832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:34.255280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:34.329106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa047-213f-4f74-9980-0d4e59eea11d None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:34.365951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:34.366690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:34.366836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:34.367125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] PATH_INFO: `/v3/projects/05add8b3a5ae44569d9919b39e960205` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:34.368318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] RBAC: Authorizing `identity:get_project(project_id=05add8b3a5ae44569d9919b39e960205)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:34.369852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437867-44a2-4d6e-bb53-bd547bff06b1 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:34.371552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 589/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:34 2022] GET /identity/v3/projects/05add8b3a5ae44569d9919b39e960205 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:34.377838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:34.434918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:34.487352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd113-a639-4d87-9c9b-0f1e07012fc2 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:34.522845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:34.523530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:34.523808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:34.524080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] PATH_INFO: `/v3/projects/05add8b3a5ae44569d9919b39e960205/users/a39595925cc74fe094c746c3fef83118/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:34.526123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=05add8b3a5ae44569d9919b39e960205, user_id=a39595925cc74fe094c746c3fef83118, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:34.527937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ada6a9-93b9-4363-8dc3-2a40e72bd0b4 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:34.547091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 603/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:02:34 2022] PUT /identity/v3/projects/05add8b3a5ae44569d9919b39e960205/users/a39595925cc74fe094c746c3fef83118/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:02:36.455972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7693b0-3080-4ed2-a919-5f9ac8ec14e9 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:36.456542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7693b0-3080-4ed2-a919-5f9ac8ec14e9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:36.456542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7693b0-3080-4ed2-a919-5f9ac8ec14e9 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:36.457872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 590/1193] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:02:36.463585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:36.464048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:36.464168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:36.483240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:02:36.484480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:02:36.555427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 604/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:02:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:02:36.836724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7693b0-3080-4ed2-a919-5f9ac8ec14e9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:36.940617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7693b0-3080-4ed2-a919-5f9ac8ec14e9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:36.942992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:36.978167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:36.979235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:36.979697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:36.980176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:36.993254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:02:36.997981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:02:36.999205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:02:37.000401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 591/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:02:37.005432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:37.053073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:37.117940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d8ac-4d7d-4c37-8985-80572539356b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:37.154376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:37.154987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:37.155286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:37.155554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:37.156225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:37.156523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:37.157885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:37.166731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 605/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:37.175785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:37.288164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fc45-e045-46e0-b3db-7b903cfcf7ff None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:37.326629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:37.327306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:37.327586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:37.327851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] PATH_INFO: `/v3/users/a39595925cc74fe094c746c3fef83118` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:37.329029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] RBAC: Authorizing `identity:get_user(user_id=a39595925cc74fe094c746c3fef83118)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:37.330483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:37.332138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 592/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 13:02:37 2022] GET /identity/v3/users/a39595925cc74fe094c746c3fef83118 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:37.338580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:37.450018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37e82-8217-41bd-87ab-5186e7220b83 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:37.452380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:37.485031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:37.485707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:37.485906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:37.486174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:37.557177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:37.558666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:37.663761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 606/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:02:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:02:37.670097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:37.711044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:37.788896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679f5a-9d0c-4fe4-b352-3c04ab27dd8e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:37.826071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:37.826716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:37.826998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:37.827307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] PATH_INFO: `/v3/projects/05add8b3a5ae44569d9919b39e960205` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:37.828464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] RBAC: Authorizing `identity:get_project(project_id=05add8b3a5ae44569d9919b39e960205)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:37.829929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285647c-293d-4809-bdc9-c601d08dbf40 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:37.831640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 593/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 13:02:37 2022] GET /identity/v3/projects/05add8b3a5ae44569d9919b39e960205 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:37.839747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:02:37.843015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:37.943578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15133-264e-488c-96fe-3998ecefe701 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:02:37.978361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:02:37.978916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:02:37.979220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:02:37.979488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:02:37.980213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=05add8b3a5ae44569d9919b39e960205, user.id=a39595925cc74fe094c746c3fef83118) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:02:37.980514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:02:37.981963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d90173-61c1-408c-8519-8b9657a2b625 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:02:37.988327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 607/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:02:37 2022] GET /identity/v3/role_assignments?user.id=a39595925cc74fe094c746c3fef83118&scope.project.id=05add8b3a5ae44569d9919b39e960205&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:02:47.821488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=50 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:02:47.985661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=66 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:34.091932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37dbf-8f5e-4918-a57e-03ddf49820bf None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:34.092773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37dbf-8f5e-4918-a57e-03ddf49820bf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:34.092900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b37dbf-8f5e-4918-a57e-03ddf49820bf None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:34.095809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 594/1201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:03:34.102729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:34.103537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:34.103537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:34.129524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:34.130894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:34.225623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 608/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:03:34.539486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37dbf-8f5e-4918-a57e-03ddf49820bf None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:34.684860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b37dbf-8f5e-4918-a57e-03ddf49820bf None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:34.726596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:34.727423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:34.727732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:34.728133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:34.741762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:34.743377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:34.773340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:34.774593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:34.775593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:34.775593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:34.775593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:34.780653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 595/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:34.782193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:34.936691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b346e-706b-4c65-8237-f32d5bbd17ec None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:34.975649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:34.993224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:34.993861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:34.994139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:34.994405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:34.997415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:34.997415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:34.997415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe298d-fef5-46ee-b67c-8c3a19435284 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:35.017743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 609/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:35.020888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:35.108050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:35.174908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b4629-7f4a-482f-bebd-b55a44ca1839 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:35.219693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:35.224228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:35.224577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:35.224781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:35.225479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:35.227091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238378-71dc-4dbe-b02e-d0f2e379fe0a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:35.256117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 596/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 13:03:35 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:03:37.388902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f58d-4f64-4521-a340-a89cd9ad4a36 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:37.389524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f58d-4f64-4521-a340-a89cd9ad4a36 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:37.389524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f58d-4f64-4521-a340-a89cd9ad4a36 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:37.390792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 610/1206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:03:37.396654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:37.397207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:37.397207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:37.418579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:37.419845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:37.501062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 597/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:03:37.768348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f58d-4f64-4521-a340-a89cd9ad4a36 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:37.896401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f58d-4f64-4521-a340-a89cd9ad4a36 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:37.945334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:37.946104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:37.946381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:37.946648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:37.965840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:03:37.971305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:37.972482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:37.976101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 611/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:37.980300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:38.033104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:38.118309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e9ed-61ea-48bc-9b4f-66ece6f6c5bd None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:38.168250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:38.168966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:38.169259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:38.169526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:38.170211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:38.170537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:38.172074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:38.187097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 598/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:38.193941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:38.257955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:38.336481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0a07-ab84-4de8-a118-361582b5ad14 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:38.383701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:38.384354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:38.384667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:38.384902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:38.404916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:38.406396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:38.423630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:38.425191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:38.426360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:38.426360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:38.426360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:38.428308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 612/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:38.436030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:38.584494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:38.589255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f8f29-2618-4c34-b15a-e6291d465b36 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:38.643003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:38.643741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:38.644050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:38.644343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:38.645031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:38.645375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:38.646863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:38.665739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 599/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:38.672222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:38.800767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb53d2-ec93-440a-9151-1980d0cbfd4f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:38.803233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:38.846994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:38.848135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:38.848691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:38.849229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:38.861413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:38.863593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:03:38.880455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:38.882360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:38.883728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 613/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:38.888629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:39.018904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ae7a-026f-4b57-a1b0-3cdb2cb91d68 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:39.082123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:39.082777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:39.083045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:39.083391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:39.084171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:39.086711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:39.086711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:39.111219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 600/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:03:39.119779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:39.244406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5170-94a9-497a-a371-cb50388f5d89 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:39.285994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:39.286618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:39.286896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:39.287168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:39.321190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:39.365712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:39.367096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:39.498756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 614/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:03:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:03:39.505274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:39.540894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:39.661990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c52e6-378d-427a-93a4-bb573eb6796c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:39.703071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:39.703771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:39.704050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:39.706276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:39.722321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:39.723870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:39.751349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:39.757351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:39.758788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:39.758788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:39.758788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:39.758788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 601/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:39.761823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:39.879072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:39.938295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcab30-5977-4fc9-a874-b5fb99dbf0b5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:39.992747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:39.993936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:39.994433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:39.994886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:39.996201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:39.996705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:39.998718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:40.016352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 615/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:03:40.022790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:40.133279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:40.178132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b446f-46cc-44d3-908f-b3c4e25561ea None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:40.240672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:40.241430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:40.241992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:40.243392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:40.251550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:40.255297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:03:40.266102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:40.271356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:40.272487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 602/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:40.273594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:40.404932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a274b32-c028-455a-aaa9-20f4936cdeaf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:40.429922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:40.442141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:40.442980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:40.443292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:40.443565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:40.444272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:40.444627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:40.446011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6c431-832d-4c41-a71b-edaafc5777b3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:40.466216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 616/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:40.467144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:40.581290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740b6d-2352-43c0-8748-edd3938e156e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:40.620193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:40.627605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:40.628366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:40.628647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:40.628917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:40.629745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f703d30d689e4a5983b5d2c39cc68cb9) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:40.630067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:40.631595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf209-0588-4a85-8eb3-4ff5ee535627 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:40.638220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 603/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:03:40 2022] GET /identity/v3/role_assignments?user.id=f703d30d689e4a5983b5d2c39cc68cb9&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:42.594406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a810-ef1c-4077-89ae-246baab45741 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:42.595093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a810-ef1c-4077-89ae-246baab45741 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:42.595093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8a810-ef1c-4077-89ae-246baab45741 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:42.596347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 617/1220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:03:42.602248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:42.602783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:42.602783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:42.623714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:42.625099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:42.710432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 604/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:03:42.994091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8a810-ef1c-4077-89ae-246baab45741 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:43.120337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8a810-ef1c-4077-89ae-246baab45741 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:43.162865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:43.163933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:43.164476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:43.164949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:43.182535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:03:43.191605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:43.192887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:43.193917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 618/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:43.200736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:43.330933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125e73c-bf5e-4361-8228-95c3c54dba04 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:43.361496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:43.379081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:43.379874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:43.379874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:43.380448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:43.381291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:43.381594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:43.383500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:43.392864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 605/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:43.399305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:43.461861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:43.531621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9685a-fc41-47a5-a7fd-6f13ffd9b413 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:43.569825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:43.570409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:43.570685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:43.570953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:43.582503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:43.583914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:43.598899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:43.601766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:43.602968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:43.602968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:43.602968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:43.602968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 619/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:43.606292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:43.730747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829bc3-9485-457e-9bcb-882eba0436a6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:43.772861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:43.773533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:43.773806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:43.774071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:43.774720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:43.775016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:43.776792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:43.791075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 606/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:43.796792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:43.902273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:43.909723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e64e-21d5-4783-abbd-52e5bb189389 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:43.951046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:43.952018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:43.952349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:43.952752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:43.962510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:43.964304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:03:43.982100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:43.983542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:43.984863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:43.989875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 620/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:03:43.990058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:44.057806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:44.128546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3eb9-245d-41ec-a4e1-0c2058e9c66e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:44.169291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:44.169824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:44.170098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:44.170366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:44.171105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:44.171446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:44.172915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:44.194364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 607/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:03:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:44.201498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:44.333551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5a2d2-7f2f-4f4e-af09-2f755c206888 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:44.383759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:44.384510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:44.384827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:44.385155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:44.402793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:44.404833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:44.421191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:44.422468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:44.423402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:44.423402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:44.423402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:44.423402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 621/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:44.430814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:44.559356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef2e98-fa32-40e7-86bc-127d1a35c3b2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:44.562213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:44.597433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:44.598154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:44.598424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:44.598692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:44.599369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:44.599682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:44.601085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:44.615724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 608/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:44.622861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:44.640422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:44.750927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3182dd-c2c1-4c7c-81d1-02e3c46d7af5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:44.797015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:44.797657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:44.797931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:44.798197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:44.805960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:44.807482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:03:44.820420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:44.821644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:44.822610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:44.827272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 622/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 13:03:44.827956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:44.956464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b0989-80cb-4b37-860b-6501990c8bca None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:45.001907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:45.002441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:45.002744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:45.003020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:45.003753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:45.004080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:45.005608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a3136-0ab7-468b-b1e7-27e9294a7257 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:45.019710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 609/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:45.029667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:45.116363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:45.159645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f2e77-bb42-4e3a-8abc-0e2613e2a476 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:45.202814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:45.203540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:45.203815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:45.204150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f703d30d689e4a5983b5d2c39cc68cb9/roles/38517e3148874268801b6c81529aa789` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:45.219963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=f703d30d689e4a5983b5d2c39cc68cb9, role_id=38517e3148874268801b6c81529aa789)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:45.221393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d2bf3-cb79-430e-a804-b4ef36d198bd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:45.238647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 623/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:03:45 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f703d30d689e4a5983b5d2c39cc68cb9/roles/38517e3148874268801b6c81529aa789 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:03:47.221011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93a29-a349-4e05-9adb-7c81e32deaa1 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:47.221765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93a29-a349-4e05-9adb-7c81e32deaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:47.221910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93a29-a349-4e05-9adb-7c81e32deaa1 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:47.224026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 610/1233] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:03:47.230483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:47.231097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:47.231097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:47.250860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:47.252123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:47.332418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 624/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:03:47.635895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca93a29-a349-4e05-9adb-7c81e32deaa1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:47.664145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:47.765808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca93a29-a349-4e05-9adb-7c81e32deaa1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:47.807162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:47.807867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:47.808147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:47.808416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:47.823081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:03:47.828297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:47.829771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:47.831833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 611/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 13:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:47.838622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:47.892566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:47.954817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238ebd1-e028-4940-9b40-d7cde4ae4871 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:48.004481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:48.005108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:48.005385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:48.005642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:48.006313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:48.006612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:48.008049 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:48.016925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 625/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 13:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:48.023035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:48.150538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:48.167107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c1b3-6f8a-4b0b-b845-efe3c5ba4a8b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:48.214156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:48.214895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:48.215269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:48.215549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:48.228586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:48.230341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:48.250056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:48.252229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:48.253352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:48.253352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:48.253352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:48.253352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 612/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:48.259674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:48.379317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba94b7-e48d-4ef4-9ae7-955c6041da72 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:48.391791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:48.420366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:48.420886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:48.421225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:48.421443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:48.422731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:48.422731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:48.423835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:48.438953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 626/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:48.445437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:48.573394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004e95b-3ea8-4137-98a5-ced43bebda63 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:48.613428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:48.614105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:48.614396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:48.614685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:48.618140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:48.623994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:48.625932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:03:48.638514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:48.639778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:48.640824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 613/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:48.646174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:48.760028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89524f-4990-4c5a-aef5-0a758b735b2f None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:48.803230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:48.803861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:48.804133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:48.804466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:48.805225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:48.805530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:48.806982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:48.827169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 627/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:03:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:48.836006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:48.965411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ecc91-258b-4148-97ea-1cec3c8c6377 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:49.005439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:49.006070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:49.006340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:49.006604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:49.073441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:49.080666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:49.082160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:49.193851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 614/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:03:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:03:49.201925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:49.233316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:49.315405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a41c8-78b5-4785-8d42-1a484f2354bf None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:49.357520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7424f5-f141-4235-9083-611053192669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:49.358126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7424f5-f141-4235-9083-611053192669 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:49.358406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7424f5-f141-4235-9083-611053192669 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:49.358677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7424f5-f141-4235-9083-611053192669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:49.370146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7424f5-f141-4235-9083-611053192669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:49.371661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7424f5-f141-4235-9083-611053192669 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-ae7424f5-f141-4235-9083-611053192669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:49.391222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:49.392451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:49.393453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:49.393453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:49.393453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:49.393453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 628/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:49.399370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:49.512705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:49.518846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48d97-2076-4163-b109-5642002c19b2 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:49.557480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:49.558107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:49.558679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:49.559105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:49.560500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:49.561011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:49.563822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:49.580940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 615/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:49.586956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7424f5-f141-4235-9083-611053192669 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:49.679163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:49.704865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7424f5-f141-4235-9083-611053192669 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:49.745859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:49.746528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:49.746802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:49.747068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:49.755967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:49.757559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:03:49.770811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:49.771946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:49.775629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 629/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:49.779706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:49.902358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f3a5f-2b54-41f9-99c4-86502d97d274 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:49.943887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:49.944605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:49.944896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:49.945216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:49.945958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:49.946258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:49.947744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dd875-085a-499c-ba20-f20e4cd5a1b8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:49.964191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 616/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:49.972989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:50.093786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1ea2-8811-4a98-a4d7-17268376c30d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:50.136527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:50.137147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:50.137423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:50.137688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:50.138421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] RBAC: Adding query filter params (role.id=38517e3148874268801b6c81529aa789, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f703d30d689e4a5983b5d2c39cc68cb9) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:50.138726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:50.140846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e8cf4-3fc8-4652-8182-5862dd97ea09 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:50.147697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 630/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:03:49 2022] GET /identity/v3/role_assignments?user.id=f703d30d689e4a5983b5d2c39cc68cb9&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=38517e3148874268801b6c81529aa789 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:52.231103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd138-6cf5-4147-b249-782411da94bf None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:52.231799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd138-6cf5-4147-b249-782411da94bf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:52.231799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd138-6cf5-4147-b249-782411da94bf None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:52.233317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 617/1247] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:03:52.239244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:52.239824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:52.239824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:52.252943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:52.269253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:52.270902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:52.358276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 631/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:03:52.623401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd138-6cf5-4147-b249-782411da94bf None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:52.646331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:52.743660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd138-6cf5-4147-b249-782411da94bf None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:52.782902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:52.783579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:52.783855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:52.784127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:52.797710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:03:52.803415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:52.804781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:52.805735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 618/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:52.811449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:52.941508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea72f7-1d94-454e-ba95-c66b14b24702 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:52.991889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:52.998445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:52.999261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:53.000045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:53.000045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:53.000724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:53.001027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:53.002421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:53.014962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 632/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:53.018067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:53.122751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:53.156932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a172-5603-4d25-8c26-4851bd27b91e None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:53.202461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:53.203034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:53.203343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:53.203613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:53.216345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:53.217970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:53.235155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:53.236811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:53.237711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:53.237711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:53.237711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:53.237711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 619/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:53.245515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:53.360480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34549a8-2161-421e-87ac-d40bf9feba6d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:53.400828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:53.401875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:53.402320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:53.402618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:53.403346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:53.403718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:53.405248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:53.419600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 633/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:53.425784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:53.541654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f213a-d8a7-45f6-adc0-864fc3b4aaab None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:53.573336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:53.588866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:53.589508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:53.589783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:53.590048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:53.598589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:53.601035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:03:53.615339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:53.616550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:53.617651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 620/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:53.623486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:53.690283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:53.741758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942d6aa-0d99-4554-9856-c2e86e0b7564 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:53.778578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:53.779388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:53.779678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:53.779950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:53.780693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:53.781000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:53.782669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:53.815356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 634/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:03:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:53.823492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:53.958871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e32758-fccc-4395-9c08-28d0a8049897 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:54.014057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:54.014708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:54.014968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:54.015351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:54.086759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:54.111753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:54.113240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:54.239656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 621/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:03:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:03:54.246504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:54.363046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5372-9450-46df-8672-545445568b53 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:54.378403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:54.402319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:54.402986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:54.403418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:54.403687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:54.415003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:54.416729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:54.433612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:54.434730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:54.435756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:54.435756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:54.435756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:54.435756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 635/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:54.442272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:54.549310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:54.566223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b642bd-d0f0-4fd4-b93a-0237998708cc None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:54.603596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:54.604214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:54.604495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:54.604761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:54.605413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:54.605748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:54.607170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:54.623108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 622/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:54.629455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:54.748314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710a10-7112-4294-80a7-2a0e138a15fa None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:54.789692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:54.790365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:54.790675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:54.791074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:54.799408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:54.800915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:03:54.814145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:54.816166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:54.817811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:03:54.822556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 636/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:54.822752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:54.952505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3260e8-2cff-4d8c-9a0c-2f6374ec9d5b None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:55.002169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:55.002916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:55.003237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:55.003514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:55.004338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:55.004611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:55.006190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70c0c-4faa-498a-92bb-5adb8fadb87b None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:55.021183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 623/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:55.028233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:55.059595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:55.165561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12476f6-f27d-4aa1-9d06-4f81ce944d1d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:55.216947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:55.217513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:55.217844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:55.218232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:55.219081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f703d30d689e4a5983b5d2c39cc68cb9) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:55.219570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:55.221891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6e4ed-04c2-465d-a092-a91d35905f7f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:55.232037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 637/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:03:55 2022] GET /identity/v3/role_assignments?user.id=f703d30d689e4a5983b5d2c39cc68cb9&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:57.235262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ba16-31d6-4c7e-a655-43518a796281 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:57.235897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ba16-31d6-4c7e-a655-43518a796281 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:57.235897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321ba16-31d6-4c7e-a655-43518a796281 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:57.237165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 624/1261] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:03:57.247434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761210-7753-4e95-8c9c-94576616127c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:57.247434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761210-7753-4e95-8c9c-94576616127c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:57.247434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761210-7753-4e95-8c9c-94576616127c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:57.265877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1b761210-7753-4e95-8c9c-94576616127c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:03:57.267459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1b761210-7753-4e95-8c9c-94576616127c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:03:57.347638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 638/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:03:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:03:57.637267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321ba16-31d6-4c7e-a655-43518a796281 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:57.649091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:57.765791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321ba16-31d6-4c7e-a655-43518a796281 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:57.804557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:57.805415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:57.805786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:57.806172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:57.823474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:03:57.829404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:57.830462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:57.831510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 625/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:57.837836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b761210-7753-4e95-8c9c-94576616127c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:57.862206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:57.970494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b761210-7753-4e95-8c9c-94576616127c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:58.024238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:58.025307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:58.025771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:58.026446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:58.027756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:58.028209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:58.030627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:58.041433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 639/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:03:58.048177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:58.130501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:58.179016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358309b-8b41-4b07-a145-7dc77f6fbbf5 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:58.219493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:58.220191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:58.220677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:58.220818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:58.232932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:58.234440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:58.250095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:58.251730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:58.252628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:58.252628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:58.252628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:58.252628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 626/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:58.257569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:58.382802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:58.406218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99c89d-ae72-4b1c-819a-f088a50c99c5 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:58.450967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:58.451644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:58.451926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:58.452195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:58.452861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:58.453163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:58.454586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:58.468558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 640/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:58.474936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:58.604005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917d345-921c-4dae-8665-3e078c93e393 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:58.627621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:58.643320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:58.643985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:58.644271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:58.644544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:58.655365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:58.656956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:03:58.669961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:58.671174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:03:58.672160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:58.675373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 627/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:58.677505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:58.798438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650c10-9149-499c-8b96-217a83a83231 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:58.843225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:58.843948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:58.844232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:58.844504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:58.845248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:58.845552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:58.847024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:58.857984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:58.868472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 641/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:03:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:58.874725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:58.998063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c51438-8c37-47cc-b3cd-9052c2f031b8 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:59.037282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:59.037948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:59.038434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:59.038779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:59.050660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:59.052136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:03:59.066593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:59.067722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:03:59.068636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:03:59.068636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:03:59.068636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:59.068636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 628/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:59.074176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:59.177750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ce16-cf93-466d-ab90-26533b4e0887 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:59.213148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:59.213765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:59.214036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:59.214302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:59.214946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:59.215276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:59.216650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:59.229350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 642/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:59.238877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:59.280304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:59.358278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1b9a-8afa-4058-8623-0ff6719baf56 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:59.394796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:59.395456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:59.395730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:59.395998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:59.403889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:59.405346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:03:59.417449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:03:59.418518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:03:59.419668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 629/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:03:59.426813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:59.487616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:59.537120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e701c16-e287-4e35-bd61-7ab30f4cd67d None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:59.576146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:59.576767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:59.577067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:59.577336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:59.578033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:03:59.578337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:59.579810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae218a-5dfa-4ef9-b84c-e7d16a3fec1f None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:59.592802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 643/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:03:59.599120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:03:59.710454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:03:59.720430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5f9d-eef0-48ab-a274-e5126d80c9db None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:03:59.763222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:03:59.763942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:03:59.764222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:03:59.764479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] PATH_INFO: `/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f703d30d689e4a5983b5d2c39cc68cb9/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:03:59.766512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] RBAC: Authorizing `identity:create_grant(project_id=67f04698f8cf4c75894d62c37b907597, user_id=f703d30d689e4a5983b5d2c39cc68cb9, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:03:59.768019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1449e-b73b-40db-8336-6a34b63eca4c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:03:59.784402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 630/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 13:03:59 2022] PUT /identity/v3/projects/67f04698f8cf4c75894d62c37b907597/users/f703d30d689e4a5983b5d2c39cc68cb9/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:04:01.670971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4a4c-5f17-4d1e-959e-c0f308d45e8f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:01.671549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4a4c-5f17-4d1e-959e-c0f308d45e8f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:01.671549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4a4c-5f17-4d1e-959e-c0f308d45e8f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:01.672878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 644/1274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:04:01.678661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:01.679170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:01.679170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:01.698058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:04:01.699286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:04:01.770521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 631/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:04:02.032997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4a4c-5f17-4d1e-959e-c0f308d45e8f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.146534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4a4c-5f17-4d1e-959e-c0f308d45e8f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:02.165593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:02.183880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:02.184512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:02.184787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:02.185057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:02.195669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 13:04:02.200329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:02.201373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:02.202267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 645/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:02.207911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.296466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:02.317153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9e298-586d-4cac-8cc4-48837736b9de None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:02.353989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:02.354610 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:02.354884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:02.355152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:02.355855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:02.356152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:02.357537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:02.366945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 632/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:02.373345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.488540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af713355-d75c-4dfd-93c0-013c7b057699 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:02.525290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:02.525945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:02.526583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:02.526829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:02.537911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:02.539446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:04:02.554757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:02.556027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:04:02.557837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:04:02.557837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:04:02.557837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:02.557837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 646/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:02.565081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.676940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ab12-5043-4c16-a7c5-ff68c9a97c93 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:02.714179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:02.714891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:02.715050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:02.715351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:02.715998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:02.716294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:02.717673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:02.730261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 633/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:02.736991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.777475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:02.854722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c15e8-a28a-45f9-942f-e032988db0d3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:02.889340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:02.889971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:02.890243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:02.890509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:02.898392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:02.899866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 13:04:02.911682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:02.912917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:02.914126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 647/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:02.920156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:02.924657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:03.040540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823a3e9-027a-4256-8ee5-43c725a0a98a None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:03.088523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:03.089157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:03.089434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:03.089701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:03.090437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:03.090740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:03.092241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:03.110374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 634/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 13:04:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:03.116437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:03.218883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:03.229084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc930b-c1ac-4c70-9e8b-4bfe5c26e1a3 None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:03.268611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:03.269236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:03.269515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:03.269789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:03.345643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:03.347117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:03.440961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:03.455277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 648/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 13:04:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 13:04:03.461446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:03.527036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:03.578752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4243-6de7-4eb3-8d79-e6764d372d9c None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:03.622709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:03.623388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:03.623661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:03.623938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:03.634847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:03.636361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 13:04:03.652346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:03.653606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 13:04:03.654723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 13:04:03.654723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 13:04:03.654723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:04:03.654723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 635/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:03.659815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:03.766292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30f7e6-4359-4a87-8ffb-2f72698a55bd None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:03.804170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:03.804804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:03.805096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:03.805343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:03.806002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:03.806299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:03.807681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:03.820030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 649/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 13:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:03.826116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:03.936061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a130c-9f66-491c-9ee1-6922eb0741d6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:03.953397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:03.980180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:03.980796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:03.981073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:03.981343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:03.990875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:03.992517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 13:04:04.010724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:04.011747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: ERROR keystone.server.flask.application Aug 24 13:04:04.012661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 636/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 13:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:04.018152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:04.081687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:04.136643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c0c7-9cdb-4597-9dc7-5d5c845b7b5e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:04.174087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:04.174699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:04.174976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:04.175274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:04.175977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:04.176306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:04.177738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcc12b-cef9-4298-8925-65f5ee157384 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:04.198657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 650/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 13:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:04.206625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:04.317122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cd176-4982-4dd9-8975-b1aa20dc53f7 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:04.355994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:04.356593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:04.356887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:04.357157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:04.357894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] RBAC: Adding query filter params (role.id=141bba58d2d74bbfa94fb0b48af0accc, scope.project.id=67f04698f8cf4c75894d62c37b907597, user.id=f703d30d689e4a5983b5d2c39cc68cb9) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:04.358206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:04.359720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba68d73-70c5-4988-897f-a12f55514e9a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:04.366909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 637/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 13:04:04 2022] GET /identity/v3/role_assignments?user.id=f703d30d689e4a5983b5d2c39cc68cb9&scope.project.id=67f04698f8cf4c75894d62c37b907597&role.id=141bba58d2d74bbfa94fb0b48af0accc => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:06.287556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e950a0-e49d-4406-9012-9a238e11e067 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:06.288248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e950a0-e49d-4406-9012-9a238e11e067 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:06.288248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e950a0-e49d-4406-9012-9a238e11e067 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:06.289692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 651/1288] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:04:06.295619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:06.296132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:06.296252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:06.316016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:04:06.317245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:04:06.348931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:06.388154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 638/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:04:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:04:06.650494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e950a0-e49d-4406-9012-9a238e11e067 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:06.761078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e950a0-e49d-4406-9012-9a238e11e067 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:06.773335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:06.798532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:06.799165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:06.799468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:06.799732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:06.800323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:06.801694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:06.810920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:06.812247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:06.813313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 652/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:04:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:06.818526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:06.931280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ad93-acae-4507-a60e-a9b33348f65d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:06.972305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:06.972922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:06.973248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:06.973465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:06.974181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:06.974465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:06.975979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca76cd4-5a74-4ff2-90e3-24a967f273f3 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:06.982867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 639/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 13:04:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:06.988941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:07.105035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa946f5-49fb-4d73-8b94-991890e2631a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:07.140494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:07.141111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:07.141391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:07.141662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] PATH_INFO: `/v3/services` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:07.142302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] RBAC: Adding query filter params (type=placement) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:07.142606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:07.144025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5c6b2-0c35-4787-9e86-31d8266b4eec None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:07.148956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 653/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 13:04:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:09.014170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ee65-1fc7-408d-b6e1-190ef1edeef3 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:09.014717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ee65-1fc7-408d-b6e1-190ef1edeef3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:09.014717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ee65-1fc7-408d-b6e1-190ef1edeef3 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:09.016110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 640/1293] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:04:09.021740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969f45-433f-4331-9700-092434452e37 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:09.022232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969f45-433f-4331-9700-092434452e37 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:09.022232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969f45-433f-4331-9700-092434452e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:09.041584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-22969f45-433f-4331-9700-092434452e37 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:04:09.042760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-22969f45-433f-4331-9700-092434452e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:04:09.072949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:09.110735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 654/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 13:04:09.376922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ee65-1fc7-408d-b6e1-190ef1edeef3 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:09.410915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:09.484219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ee65-1fc7-408d-b6e1-190ef1edeef3 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:09.519003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:09.519715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:09.519987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:09.520254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:09.520905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:09.522283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f0749-882f-4548-b857-51500875d3d5 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:09.539607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 641/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 13:04:09 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:04:11.434506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63005-4c61-4789-a963-370b3b6ab056 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:11.435154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63005-4c61-4789-a963-370b3b6ab056 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:11.435154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63005-4c61-4789-a963-370b3b6ab056 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:11.436448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 655/1296] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:04:11.441839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:11.442265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:11.442383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:11.461052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:04:11.462283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:04:11.537491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 642/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:04:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:04:11.803165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63005-4c61-4789-a963-370b3b6ab056 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:11.908901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63005-4c61-4789-a963-370b3b6ab056 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:11.945179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:11.945815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:11.946171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:11.946562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:11.947321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:11.948782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:11.958126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:11.959289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:11.960458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 656/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:04:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:11.965751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:11.986328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:12.073376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319000a-aa88-4ba5-8e59-ca268e581f57 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:12.110766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:12.111398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:12.111687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:12.112013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:12.112664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:12.112962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:12.114343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:12.119678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 643/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 13:04:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:12.125944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:12.160143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:12.231844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c43aa-5d90-469e-9ec6-f426fd882a1e None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:12.266227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:12.266823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:12.267099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:12.267379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:12.268095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] RBAC: Adding query filter params (interface=public, service_id=52ef506187d144b0b9040ddc638e71cb, region_id=RegionOne) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:12.268405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:12.269775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e06e5-5e59-4d35-8a07-09308b811fc7 None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:12.274912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 657/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 13:04:12 2022] GET /identity/v3/endpoints?service_id=52ef506187d144b0b9040ddc638e71cb&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:12.281265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:12.367153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:12.386878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d0f-a6e3-4097-9377-1e9930b812c6 None admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:12.422794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395886c8-da85-403c-8d25-0264769b733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:12.423477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395886c8-da85-403c-8d25-0264769b733d None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:12.423842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395886c8-da85-403c-8d25-0264769b733d None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:12.424113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395886c8-da85-403c-8d25-0264769b733d None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:12.424703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395886c8-da85-403c-8d25-0264769b733d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:12.426115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395886c8-da85-403c-8d25-0264769b733d None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:12.433032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 644/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 13:04:12 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:04:14.308018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24956411-9080-45a4-9026-4242dbcf168b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:14.308580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24956411-9080-45a4-9026-4242dbcf168b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:14.308580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24956411-9080-45a4-9026-4242dbcf168b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:14.309909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 658/1302] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:04:14.315312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:14.315736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:14.315958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:14.335488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:04:14.336769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:04:14.412066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 645/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:04:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 13:04:14.674735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24956411-9080-45a4-9026-4242dbcf168b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:14.775752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:14.783598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24956411-9080-45a4-9026-4242dbcf168b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:14.818441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:14.819070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:14.819375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:14.819646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:14.820224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:14.821641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 13:04:14.830547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 13:04:14.832985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application with Lock( Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self._enter() Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application return self.creator() Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application created_value = creator( Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: ERROR keystone.server.flask.application Aug 24 13:04:14.834028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 659/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 13:04:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 13:04:14.837935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:14.915985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:14.941420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e1be7-3cfa-4dc3-9a91-c9452a92bd99 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:14.981807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:14.982530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:14.982905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:14.983157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] PATH_INFO: `/v3/services` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:14.983922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:04:14.984296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:14.985989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16991-b6f8-43e3-b5f2-7a46d4b6c61a None admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:14.992515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 646/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 13:04:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:04:14.998542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:04:15.105416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21cf70-ff93-415a-8d58-a90d76271b2a None admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:04:15.146108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:04:15.146729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:04:15.147002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:04:15.147303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:04:15.147960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:04:15.149384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19beae14-ed2a-40c1-b15c-fbd67cf0e4de None admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:04:15.172923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 660/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:04:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:04:24.988793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=30 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:04:25.168216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:20.536298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e6a2-435b-4368-9b69-72c3c1211393 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:20.536896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e6a2-435b-4368-9b69-72c3c1211393 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:20.536896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e6a2-435b-4368-9b69-72c3c1211393 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:20.538237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 647/1307] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:20.543839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a8a6c-962b-45ec-8704-66b60aa2c1f3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:20.544362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a8a6c-962b-45ec-8704-66b60aa2c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:20.544362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a8a6c-962b-45ec-8704-66b60aa2c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:20.807209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e83a8a6c-962b-45ec-8704-66b60aa2c1f3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:20.808830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e83a8a6c-962b-45ec-8704-66b60aa2c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:21.000269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 661/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:21.303828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:21.304468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:21.304962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:21.306638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 648/1309] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 24 13:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:05:21.314009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8709-681a-4c9a-859a-d2e54b081070 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:21.314702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8709-681a-4c9a-859a-d2e54b081070 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:21.315291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8709-681a-4c9a-859a-d2e54b081070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:21.441720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e8df8709-681a-4c9a-859a-d2e54b081070 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:21.443860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e8df8709-681a-4c9a-859a-d2e54b081070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:21.471638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:21.559829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 662/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 24 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:05:21.569558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:21.572136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:21.713424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb650-a94c-486d-ae28-de33ba2dd27a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:21.839789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:21.840787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:21.841260 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:21.841888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:21.843792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:21.907394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:21.980439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:21.982367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3ed6d-0d3e-41e8-8776-b45114cc56ca service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:22.004972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 649/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:24.278038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:24.278714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:24.278714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:24.280046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 663/1312] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:24.286050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759e57-0c41-4970-97ec-5e68a0b6a924 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:24.286707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759e57-0c41-4970-97ec-5e68a0b6a924 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:24.286707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759e57-0c41-4970-97ec-5e68a0b6a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:24.366495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e3759e57-0c41-4970-97ec-5e68a0b6a924 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:24.368057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e3759e57-0c41-4970-97ec-5e68a0b6a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:24.507481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 650/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:24.786139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:24.787803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:24.911529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6f399-f7d1-4156-ab80-09f1564631c9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:24.986748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:24.990079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:24.990822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:24.991145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:24.991816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:24.994050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:25.117129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:25.118610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ad4f0-0953-4d36-9c94-6187f9260433 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:25.143653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 664/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:27.351719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:27.352314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:27.352314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:27.353664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 651/1315] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:27.359312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2b4-e37a-4bc3-9154-175fa9e59937 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:27.359848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2b4-e37a-4bc3-9154-175fa9e59937 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:27.359848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2b4-e37a-4bc3-9154-175fa9e59937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:27.434601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2235c2b4-e37a-4bc3-9154-175fa9e59937 None None] MFA Rules not processed for user `bd9326dd9b2d45b3bd97273a5c20fde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:27.435845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2235c2b4-e37a-4bc3-9154-175fa9e59937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:27.491957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:27.541571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 665/1316] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:27.825014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:27.826611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:27.837274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:27.944584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a31df-45c1-4647-9e01-8a0f2566dbad None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:28.026605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:28.027304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:28.027585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:28.027855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:28.029757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:28.105917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:28.158103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:28.159614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c681285-1556-423f-971a-03a389e60bb6 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:28.186203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 652/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:30.779249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63f2c-f32d-4b1a-b066-96a84d515903 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:30.779809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63f2c-f32d-4b1a-b066-96a84d515903 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:30.779809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63f2c-f32d-4b1a-b066-96a84d515903 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:30.781188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 666/1318] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:30.787697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aad24f-33bf-4bd9-8734-901e2d79df42 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:30.788169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aad24f-33bf-4bd9-8734-901e2d79df42 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:30.788169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aad24f-33bf-4bd9-8734-901e2d79df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:30.862334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-85aad24f-33bf-4bd9-8734-901e2d79df42 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:30.863620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-85aad24f-33bf-4bd9-8734-901e2d79df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:30.968959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 653/1319] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:31.261103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:31.261384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:31.261657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:31.263048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 667/1320] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 24 13:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:31.271423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2dd7-cf62-4348-96dc-8689dbd23bb2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:31.271713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2dd7-cf62-4348-96dc-8689dbd23bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:31.271989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d2dd7-cf62-4348-96dc-8689dbd23bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:31.296142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:31.355300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d49d2dd7-cf62-4348-96dc-8689dbd23bb2 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:31.356541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d49d2dd7-cf62-4348-96dc-8689dbd23bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:31.440706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 654/1321] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 24 13:05:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:31.451128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:31.452723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:31.575367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7789b41-a7cf-4bab-aa58-73e1b6cb2e06 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:31.658074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:31.658688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:31.658960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:31.659320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:31.660944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:31.668361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:31.784769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:31.786437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a732241-5a65-49fa-b389-2fd13a09553d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:31.806600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 668/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:34.922033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:34.922873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:34.922873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:34.923896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 655/1323] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:34.929806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d4fd-c5d2-4f00-9d0a-54ebf9fa5571 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:34.930353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d4fd-c5d2-4f00-9d0a-54ebf9fa5571 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:34.930353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d4fd-c5d2-4f00-9d0a-54ebf9fa5571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:35.011599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a651d4fd-c5d2-4f00-9d0a-54ebf9fa5571 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:35.013604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a651d4fd-c5d2-4f00-9d0a-54ebf9fa5571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:35.081032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:35.124720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 669/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:05:35.405974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:35.408104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:35.539769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77282784-6d0f-4607-9238-9c54be0e95b5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:35.553238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:35.631056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:35.631707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:35.631986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:35.632265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:35.633923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:35.771393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:35.772855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f05cf9-af3d-448e-986f-0e9310775167 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:35.792133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 656/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:37.816732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:37.817292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:37.817292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:37.818813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 670/1326] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:05:37.824607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b415-c154-4da9-9988-1874ddae3a49 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:37.825065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b415-c154-4da9-9988-1874ddae3a49 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:37.825170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9b415-c154-4da9-9988-1874ddae3a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:37.875815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:37.896414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c3b9b415-c154-4da9-9988-1874ddae3a49 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:37.897958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c3b9b415-c154-4da9-9988-1874ddae3a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:38.004897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 657/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:38.284136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:38.285683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:38.409282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541c074-4519-4618-b21d-1bb0b33313bf None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:38.486730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:38.487402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:38.487717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:38.487999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:38.489639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:38.512133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:38.624786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:38.626273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075de4ef-2f61-41cc-bfd9-09f4a6ef8fcf service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:38.645879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 671/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:40.644390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:40.644951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:40.644951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:40.646298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 658/1329] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:40.653552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4ad7-6daf-4332-94c7-f3fa4b91f9cf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:40.654322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4ad7-6daf-4332-94c7-f3fa4b91f9cf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:40.654322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4ad7-6daf-4332-94c7-f3fa4b91f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:40.731619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9c7a4ad7-6daf-4332-94c7-f3fa4b91f9cf None None] MFA Rules not processed for user `bd9326dd9b2d45b3bd97273a5c20fde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:40.732840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9c7a4ad7-6daf-4332-94c7-f3fa4b91f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:40.802823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:40.842479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 672/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:05:41.120422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:41.121995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:41.235241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056389-ebcc-4237-aa85-e76d080ab7d0 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:41.258531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:41.324768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:41.325259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:41.325500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:41.325774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:41.327443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:41.457769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:41.459286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be778343-d729-4dc6-aa54-11c517a525f3 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:41.478301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 659/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:43.687305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:43.687880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:43.687880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:43.689308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 673/1332] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:43.695833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c82-8597-41b9-8c43-310594a6e0e2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:43.696320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c82-8597-41b9-8c43-310594a6e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:43.696435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207c82-8597-41b9-8c43-310594a6e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:43.769256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:43.772579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-51207c82-8597-41b9-8c43-310594a6e0e2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:43.774454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-51207c82-8597-41b9-8c43-310594a6e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:43.877049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 660/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:44.154068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:44.155786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:44.268908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dc74b-754d-4730-8100-95e0348f4719 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:44.347008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:44.347640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:44.347912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:44.348176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:44.349785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:44.378770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:44.480409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:44.481781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964bb3d-732f-4ba9-a998-9526c187d67f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:44.504225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 674/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:46.497387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:46.497965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:46.497965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:46.499254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 661/1335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:46.505321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc268-7541-4161-991a-b315268458d4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:46.505831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc268-7541-4161-991a-b315268458d4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:46.505831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc268-7541-4161-991a-b315268458d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:46.588623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-409dc268-7541-4161-991a-b315268458d4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:46.589902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-409dc268-7541-4161-991a-b315268458d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:46.677528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:46.702100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 675/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:46.991960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:46.993506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:47.124272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc7c9-1b61-4751-ae9f-6e6ef70a2fd6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:47.161567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:47.214823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:47.215513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:47.215784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:47.216052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:47.217695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:47.346387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:47.347890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dc091-3e9e-4f1d-9bf1-a033873ebba6 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:47.366685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 662/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:49.732524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:49.733099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:49.733099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:49.734412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 676/1338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:49.740099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d043b-a799-4e7e-b449-29fa43f711c4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:49.740726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d043b-a799-4e7e-b449-29fa43f711c4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:49.740726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d043b-a799-4e7e-b449-29fa43f711c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:49.816893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-7a4d043b-a799-4e7e-b449-29fa43f711c4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:49.818155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7a4d043b-a799-4e7e-b449-29fa43f711c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:49.828070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:49.943951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 663/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:50.221647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:50.223232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:50.334587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646b374-8cae-457e-b7f8-6dfb1ab4ae9c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:50.411933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:50.412581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:50.412857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:50.413126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:50.414761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:50.453607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:50.553970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:50.555495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b529c5-3cd0-46bb-9263-554d917f957f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:50.577968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 677/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:54.755842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:54.756828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:54.756828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:54.758229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 664/1341] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:54.764114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf019eb-e760-40fe-bbe9-cfd0e565c7f1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:54.764683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf019eb-e760-40fe-bbe9-cfd0e565c7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:54.764834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf019eb-e760-40fe-bbe9-cfd0e565c7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:54.839643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-aaf019eb-e760-40fe-bbe9-cfd0e565c7f1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:54.840952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-aaf019eb-e760-40fe-bbe9-cfd0e565c7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:54.947995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:54.962681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 678/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:55.242180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:55.243921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:55.362822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74de8-36a8-4960-9850-a7f104c8997d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:55.405197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:55.443811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:55.444586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:55.445014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:55.445466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:55.448266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:55.593319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:55.594949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4187c-7b69-4f4b-a91e-a4cc06547cb3 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:55.618752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 665/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:05:58.227605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:58.228209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:58.228209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:58.229535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 679/1344] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:05:58.235507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5c5b-5956-4142-b690-3ccc60abdc1d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:58.236076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5c5b-5956-4142-b690-3ccc60abdc1d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:58.236076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a5c5b-5956-4142-b690-3ccc60abdc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:58.313234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9c6a5c5b-5956-4142-b690-3ccc60abdc1d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:05:58.314467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9c6a5c5b-5956-4142-b690-3ccc60abdc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:58.334091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:58.424311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 666/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:05:58.706753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:05:58.708639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:58.822841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07c1c3-24f5-4294-aaa4-9de007ec5943 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:05:58.905709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:05:58.906322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:05:58.906595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:05:58.906861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:05:58.908562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:05:58.961667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:05:59.036985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:05:59.038491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac771f1-d84a-4334-b18d-008006cdb2e3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:05:59.059263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 680/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:05:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:03.464933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:03.465431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:03.465597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:03.467814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 667/1347] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:03.473577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200dc13-be6f-4941-830a-88b3eaa5b66d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:03.474152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200dc13-be6f-4941-830a-88b3eaa5b66d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:03.474152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200dc13-be6f-4941-830a-88b3eaa5b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:03.550355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5200dc13-be6f-4941-830a-88b3eaa5b66d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:03.551717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5200dc13-be6f-4941-830a-88b3eaa5b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:03.673535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:03.677620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 681/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:03.986355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:03.988072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:04.123462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22b521-e7ea-4418-98de-5e309339579f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:04.173313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:04.202593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:04.203245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:04.203538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:04.203806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:04.205469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:04.325468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:04.326937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82476fd-d04b-48ea-8bee-82bf03c03ce1 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:04.347378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 668/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:09.394174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533181ac-55a8-4b20-ac5e-bc425c5250a7 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:09.394814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533181ac-55a8-4b20-ac5e-bc425c5250a7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:09.394814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533181ac-55a8-4b20-ac5e-bc425c5250a7 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:09.397029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 682/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:09.402623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde073-3c3e-4960-8d0f-da9ba174176a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:09.403084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde073-3c3e-4960-8d0f-da9ba174176a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:09.403201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde073-3c3e-4960-8d0f-da9ba174176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:09.515364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dbfde073-3c3e-4960-8d0f-da9ba174176a None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:09.517148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dbfde073-3c3e-4960-8d0f-da9ba174176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:09.544363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:09.689738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 669/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:13.877120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e87d-2e26-49d2-b352-2fffcc7ca98e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:13.877655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e87d-2e26-49d2-b352-2fffcc7ca98e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:13.879681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e87d-2e26-49d2-b352-2fffcc7ca98e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:13.881116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 683/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:13.887261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354e32-7561-49f1-b67e-5280c896732e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:13.887773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354e32-7561-49f1-b67e-5280c896732e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:13.887773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354e32-7561-49f1-b67e-5280c896732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:13.967726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d9354e32-7561-49f1-b67e-5280c896732e None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:13.969280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d9354e32-7561-49f1-b67e-5280c896732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:14.046129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:14.084848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 670/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:15.459360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c960bd-a764-4a6e-9e7d-d312c196ad75 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:15.459922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c960bd-a764-4a6e-9e7d-d312c196ad75 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:15.459922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c960bd-a764-4a6e-9e7d-d312c196ad75 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:15.461446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 684/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:15.467061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592e40-41ab-4860-b607-e84f3526388a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:15.467587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592e40-41ab-4860-b607-e84f3526388a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:15.467836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb592e40-41ab-4860-b607-e84f3526388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:15.551686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cb592e40-41ab-4860-b607-e84f3526388a None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:15.552945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cb592e40-41ab-4860-b607-e84f3526388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:15.663088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 671/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:19.064647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd46-e4c8-40d9-bac6-e87aaa730190 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:19.065221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd46-e4c8-40d9-bac6-e87aaa730190 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:19.065221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78cd46-e4c8-40d9-bac6-e87aaa730190 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:19.066487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 685/1356] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:19.072266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473624-1f93-4786-8977-52f14846da5b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:19.072698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473624-1f93-4786-8977-52f14846da5b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:19.072803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473624-1f93-4786-8977-52f14846da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:19.109148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:19.153414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1e473624-1f93-4786-8977-52f14846da5b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:19.155767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1e473624-1f93-4786-8977-52f14846da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:19.280208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 672/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:19.591499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:19.591956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:19.592349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:19.593917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 686/1358] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 13:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:19.604254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba60193-05ba-4e8c-9b67-f8828f2f4e54 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:19.604882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba60193-05ba-4e8c-9b67-f8828f2f4e54 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:19.605405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba60193-05ba-4e8c-9b67-f8828f2f4e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:19.706155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4ba60193-05ba-4e8c-9b67-f8828f2f4e54 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:19.707701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4ba60193-05ba-4e8c-9b67-f8828f2f4e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:19.760586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:19.837195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 673/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:19.845513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:19.847040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:20.014606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ea319-08c2-49c0-8606-38b2e080b488 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:20.099725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:20.150564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:20.151406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:20.151797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:20.152188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:20.153909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:20.256317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:20.257968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a30b8-4960-486f-80e2-894e60bb6105 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:20.277425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 687/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:06:22.435801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:22.436250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:22.436340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:22.443104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd3f1-6fb7-4b03-afda-e534f2a8e7af None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:22.443597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd3f1-6fb7-4b03-afda-e534f2a8e7af None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:22.443597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bd3f1-6fb7-4b03-afda-e534f2a8e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:22.448242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 674/1361] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:22.517261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-870bd3f1-6fb7-4b03-afda-e534f2a8e7af None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:22.518454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-870bd3f1-6fb7-4b03-afda-e534f2a8e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:22.560882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:22.643881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 688/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:22.943630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:22.945969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:23.133093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9ae1-76e8-4a0d-82b8-9a2d58937166 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:23.144897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:23.276032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:23.276562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:23.276838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:23.277102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:23.278761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:23.408229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:23.410331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360be9b-4635-4b1c-854a-baa50e981e34 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:23.430041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 675/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:25.677445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c367b-ea02-4b80-a39d-4f4b0b6f7dfb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:25.678040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c367b-ea02-4b80-a39d-4f4b0b6f7dfb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:25.678040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c367b-ea02-4b80-a39d-4f4b0b6f7dfb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:25.679623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 689/1364] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:25.685882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86906a-fbd7-4631-a441-ac3c36a3b844 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:25.686753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86906a-fbd7-4631-a441-ac3c36a3b844 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:25.686753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86906a-fbd7-4631-a441-ac3c36a3b844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:25.704777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:25.772438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0f86906a-fbd7-4631-a441-ac3c36a3b844 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:25.773694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0f86906a-fbd7-4631-a441-ac3c36a3b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:25.887450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 676/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:26.182958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:26.183461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:26.183812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:26.185352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 690/1366] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 13:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:26.191285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed14f-c77b-40e2-a5a1-8abc425aa8ba None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:26.191828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed14f-c77b-40e2-a5a1-8abc425aa8ba None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:26.191828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ed14f-c77b-40e2-a5a1-8abc425aa8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:26.288825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-691ed14f-c77b-40e2-a5a1-8abc425aa8ba None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:26.290083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-691ed14f-c77b-40e2-a5a1-8abc425aa8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:26.332056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:26.452883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 677/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:26.462050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:26.463714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:26.640190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4dd52-0cce-4515-9df9-0246734ab92a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:26.663910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:26.777959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:26.778698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:26.779078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:26.779078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:26.780956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:26.882391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:26.883997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096857c4-7ea5-4745-b796-b3f202a9f65d service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:26.904947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 691/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:27.386326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa13a-d9d8-4780-9586-ce7cd4f63733 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:27.386905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa13a-d9d8-4780-9586-ce7cd4f63733 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:27.387289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaa13a-d9d8-4780-9586-ce7cd4f63733 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:27.390367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 678/1369] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:27.396401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11d1b-a9e2-4c27-8a3c-f912fc081e23 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:27.396693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11d1b-a9e2-4c27-8a3c-f912fc081e23 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:27.397108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e11d1b-a9e2-4c27-8a3c-f912fc081e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:27.431682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:27.471785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-59e11d1b-a9e2-4c27-8a3c-f912fc081e23 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:27.473636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59e11d1b-a9e2-4c27-8a3c-f912fc081e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:27.585779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 692/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:28.204384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:28.204999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:28.205335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:28.206900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 679/1371] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 24 13:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:28.212560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3923-da55-4b81-bac4-01b9c838f1c6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:28.213051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3923-da55-4b81-bac4-01b9c838f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:28.213051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3923-da55-4b81-bac4-01b9c838f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:28.299538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ba1a3923-da55-4b81-bac4-01b9c838f1c6 None None] MFA Rules not processed for user `b99f8096be0f41399f34257c8a1cd5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:28.300754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ba1a3923-da55-4b81-bac4-01b9c838f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:28.358916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:28.394412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 693/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 24 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:28.403243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:28.405141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:28.524845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb66f6-6cfd-4e67-9f33-f702867f0adc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:28.575820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:28.614226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:28.614986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:28.615350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:28.615639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:28.617315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:28.789631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:28.791110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3d13d-c3d0-40d2-bc87-0f8756fc2003 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:28.831384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 680/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:28.996477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:28.996761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:28.997036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:28.998394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 694/1374] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:29.004033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb496d3-81dc-4212-8d47-93d678614b2d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:29.004322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb496d3-81dc-4212-8d47-93d678614b2d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:29.004597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb496d3-81dc-4212-8d47-93d678614b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:29.072916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8eb496d3-81dc-4212-8d47-93d678614b2d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:29.074069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8eb496d3-81dc-4212-8d47-93d678614b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:29.096078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:29.174160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 681/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:29.456874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:29.458547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:29.625686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4863eb-be22-43a9-92b8-6b4efe4b0614 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:29.692572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:29.755004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:29.755741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:29.756043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:29.756309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:29.757924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:29.850233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:29.851857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf09c2e-713f-40c8-bd2d-c6e5f59c23d0 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:29.870936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 695/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:31.950154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:31.950803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:31.950803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:31.952562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 682/1377] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:31.959086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6e7b-5522-4933-8f61-c86f2de8649d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:31.959926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6e7b-5522-4933-8f61-c86f2de8649d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:31.959926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6e7b-5522-4933-8f61-c86f2de8649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:32.032973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-497f6e7b-5522-4933-8f61-c86f2de8649d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:32.036611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-497f6e7b-5522-4933-8f61-c86f2de8649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:32.043639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:32.150572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 696/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:32.448799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:32.450318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:32.639052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da98597-0160-40a7-934c-e2d4cd099caa None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:32.643465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:32.765604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:32.766408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:32.766804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:32.767135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:32.768855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:32.872552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:32.874246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bc99-40ce-4c9e-a74b-e51815c5ecee service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:32.893406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 683/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:34.950512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:34.951654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:34.951654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:34.952660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 697/1380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:34.958776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9e15-2be9-40e0-b715-0496fa4a8c09 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:34.959376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9e15-2be9-40e0-b715-0496fa4a8c09 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:34.959487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9e15-2be9-40e0-b715-0496fa4a8c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:34.971406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:35.031247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a25a9e15-2be9-40e0-b715-0496fa4a8c09 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:35.032474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a25a9e15-2be9-40e0-b715-0496fa4a8c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:35.135227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 684/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:35.429367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:35.430893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:35.582552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:35.594058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c876a1-aba6-4a6c-8355-38f9f4d495cb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:35.723466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:35.724282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:35.724633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:35.725002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:35.726723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:35.822281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:35.824093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf12a9-6e26-4a8e-a102-4c8848e885bf service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:35.835444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:35.845022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 698/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:37.798710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:37.799445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:37.799445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:37.800639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 685/1383] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:37.806442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea8d3-3f75-4033-b18e-d10f9f41f325 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:37.807291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea8d3-3f75-4033-b18e-d10f9f41f325 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:37.807291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea8d3-3f75-4033-b18e-d10f9f41f325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:37.877466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-842ea8d3-3f75-4033-b18e-d10f9f41f325 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:37.878633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-842ea8d3-3f75-4033-b18e-d10f9f41f325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:37.978216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 699/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:38.348047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:38.349877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:38.454376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:38.520159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cec12f-de7f-4ffd-abda-524d137565ee None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:38.668392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:38.669165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:38.669591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:38.669881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:38.672079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:38.753400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:38.804788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:38.806430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebf6ee-a98f-4741-baa8-5b8d46b0fc48 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:38.825467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 686/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:40.949043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:40.949043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:40.949628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:40.950878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 700/1386] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:40.956825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11e45-dd77-4a35-93fd-4cbf212006ab None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:40.957268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11e45-dd77-4a35-93fd-4cbf212006ab None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:40.957359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11e45-dd77-4a35-93fd-4cbf212006ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:41.032577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ecb11e45-dd77-4a35-93fd-4cbf212006ab None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:41.035322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ecb11e45-dd77-4a35-93fd-4cbf212006ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:41.160983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 687/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:41.452181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:41.453767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:41.542298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:41.634565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f0a1-5e8c-40e1-9495-c1fffb699331 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:41.769030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:41.769659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:41.769933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:41.770203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:41.771834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:41.811250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:41.865980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:41.869581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411354b-e708-469f-900d-dbfe12f75939 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:41.894730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 701/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:43.804199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded9d-ee30-4b4f-a282-9e87ee3710fd None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:43.804795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded9d-ee30-4b4f-a282-9e87ee3710fd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:43.804795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded9d-ee30-4b4f-a282-9e87ee3710fd None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:43.807230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 688/1389] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:43.812639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:43.813190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:43.813190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:43.890765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:43.892070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:43.893621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be9ea-3855-4972-9338-c0319105d372 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:43.894348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be9ea-3855-4972-9338-c0319105d372 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:43.895445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be9ea-3855-4972-9338-c0319105d372 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:43.897721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 689/1390] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:43.903613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148afd2b-4c56-407c-acee-6baf6240b297 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:43.903824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148afd2b-4c56-407c-acee-6baf6240b297 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:43.904136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148afd2b-4c56-407c-acee-6baf6240b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:43.941593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:43.980368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-148afd2b-4c56-407c-acee-6baf6240b297 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:43.981761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-148afd2b-4c56-407c-acee-6baf6240b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:44.015601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 702/1391] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:44.082266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 690/1392] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:44.302863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:44.304254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:44.321816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:44.389996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988d97-ae87-421b-854d-fdf288bc592f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:44.390357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988d97-ae87-421b-854d-fdf288bc592f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:44.390699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b988d97-ae87-421b-854d-fdf288bc592f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:44.392143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 691/1393] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 24 13:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:06:44.397235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:44.397518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:44.397791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:44.430883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e6019-77ce-400d-9643-91646453ad11 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:44.477163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] MFA Rules not processed for user `6c2ed0e5eabf49d2816ab27e21e54985`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:44.478401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:44.531986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:44.546256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:44.546843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:44.547148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:44.547447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:44.549052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:44.558338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:44.563339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 692/1394] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 24 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:44.569566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:44.578510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6452c-10e5-418f-8e85-9ed10252f39c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:44.650317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:44.651987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354d965-25f8-4eca-8af3-4f5c710ea574 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:44.664711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:44.665333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:44.665614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:44.665882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:44.667559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:44.671310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 703/1395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:44.797860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:44.799736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab11f-5519-4e69-a630-c5b31564b545 service glance] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:44.817744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:44.823313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 693/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:06:45.602484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c70ef-a8c5-49ae-ba9b-b670ba7e012d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:45.603238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c70ef-a8c5-49ae-ba9b-b670ba7e012d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:45.603238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c70ef-a8c5-49ae-ba9b-b670ba7e012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:45.676096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f08c70ef-a8c5-49ae-ba9b-b670ba7e012d None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:45.677477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f08c70ef-a8c5-49ae-ba9b-b670ba7e012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:45.763997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:45.771532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 704/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:45.815928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:45.816217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:45.816494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:45.817960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 694/1398] 10.222.0.47 () {54 vars in 943 bytes} [Wed Aug 24 13:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:45.824800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcbb2-3420-439d-a44a-2719e48f7691 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:45.825149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcbb2-3420-439d-a44a-2719e48f7691 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:45.825486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fcbb2-3420-439d-a44a-2719e48f7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:45.907020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0c0fcbb2-3420-439d-a44a-2719e48f7691 None None] MFA Rules not processed for user `79dc27d463f446a3a8da3aff55b6603e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:45.908102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0c0fcbb2-3420-439d-a44a-2719e48f7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:46.022464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 705/1399] 10.222.0.47 () {58 vars in 1040 bytes} [Wed Aug 24 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:46.032484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:46.034045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:46.178545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28705-7c34-4c6b-b4e9-1a4d003c489f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:46.268563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:46.290452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:46.291069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:46.291380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:46.291656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:46.293316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:46.384144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:46.385799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922615a7-6bd0-4282-bb37-788e4f51e9bc service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:46.394160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 695/1400] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:06:46.611013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:46.611584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:46.611814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:46.621263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 706/1401] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:46.623370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695fd53-f549-41fe-999c-c840fcac8225 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:46.623886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695fd53-f549-41fe-999c-c840fcac8225 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:46.624378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695fd53-f549-41fe-999c-c840fcac8225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:46.725305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-7695fd53-f549-41fe-999c-c840fcac8225 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:46.726925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7695fd53-f549-41fe-999c-c840fcac8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:46.811213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:46.847474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 696/1402] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:06:47.134688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:47.136262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:47.208737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:47.309881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc9618-69e9-4483-9c9d-9adf8f7be2f3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:47.444268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:47.444926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:47.445213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:47.445539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:47.447265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:47.467596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:47.551723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:47.553537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6261a-a956-409c-944e-06b2b497589e service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:47.574894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 707/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:49.538657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532125e9-a58e-473e-b522-7c646d027961 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:49.539492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532125e9-a58e-473e-b522-7c646d027961 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:49.539492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532125e9-a58e-473e-b522-7c646d027961 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:49.545300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 697/1404] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:49.547092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535a9a-cac0-42df-9b73-6bbcbfaa286e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:49.547592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535a9a-cac0-42df-9b73-6bbcbfaa286e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:49.547694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0535a9a-cac0-42df-9b73-6bbcbfaa286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:49.634992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c0535a9a-cac0-42df-9b73-6bbcbfaa286e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:49.636284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c0535a9a-cac0-42df-9b73-6bbcbfaa286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:49.756431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:49.764563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 708/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:50.056431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532125e9-a58e-473e-b522-7c646d027961 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:50.057969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-532125e9-a58e-473e-b522-7c646d027961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:50.226283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532125e9-a58e-473e-b522-7c646d027961 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:50.290174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:50.367009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:50.368026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:50.368570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:50.369077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:50.372281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:50.487605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:50.489638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9238ac4-a0a7-42c1-a31c-8097ce518b96 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:50.509191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 698/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:06:52.533361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:52.533955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:52.533955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:52.535277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 709/1407] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:06:52.542393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d869-7a86-415c-8f57-4ae60b6c67f0 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:52.542902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d869-7a86-415c-8f57-4ae60b6c67f0 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:52.542990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d869-7a86-415c-8f57-4ae60b6c67f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:52.620555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f003d869-7a86-415c-8f57-4ae60b6c67f0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:06:52.621874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f003d869-7a86-415c-8f57-4ae60b6c67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:52.648471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:52.754022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 699/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:06:53.046672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:06:53.048181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:53.215721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a06e64-b511-4b9a-9e6a-4389693e656e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:06:53.291297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:06:53.342646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:06:53.343176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:06:53.343478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:06:53.343749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:06:53.345400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:06:53.436633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:06:53.438269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea0f4f-9ec8-4b71-8bbf-f3f5a6a44fc2 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:06:53.465098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 710/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:02.752339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=38 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:03.457798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=64 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:08.382522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33540d21-3a77-45e5-bdd3-db8252f9f1d7 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:08.383157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33540d21-3a77-45e5-bdd3-db8252f9f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:08.383157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33540d21-3a77-45e5-bdd3-db8252f9f1d7 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:08.384446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 700/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 24 13:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:08.393276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137f0-7644-44a5-8508-7e8172b1771d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:08.393734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137f0-7644-44a5-8508-7e8172b1771d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:08.393837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137f0-7644-44a5-8508-7e8172b1771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:08.476914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0d0137f0-7644-44a5-8508-7e8172b1771d None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:08.478141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d0137f0-7644-44a5-8508-7e8172b1771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:08.594109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 711/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:08.615986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169386-261e-4826-b591-06073dab25e5 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:08.616612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169386-261e-4826-b591-06073dab25e5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:08.616887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169386-261e-4826-b591-06073dab25e5 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:08.618388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 701/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 24 13:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:08.623552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf34dd-f3fc-4d2b-b185-8e4c16ab6a18 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:08.623840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf34dd-f3fc-4d2b-b185-8e4c16ab6a18 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:08.624113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf34dd-f3fc-4d2b-b185-8e4c16ab6a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:08.713595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:08.716791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ecaf34dd-f3fc-4d2b-b185-8e4c16ab6a18 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:08.718819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ecaf34dd-f3fc-4d2b-b185-8e4c16ab6a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:08.844931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 712/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:11.272253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:11.272834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:11.272834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:11.274233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:11.280380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821ffa-9c1d-401d-99b0-edf8d80fad1d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:11.280887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821ffa-9c1d-401d-99b0-edf8d80fad1d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:11.280887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821ffa-9c1d-401d-99b0-edf8d80fad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:11.348280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d2821ffa-9c1d-401d-99b0-edf8d80fad1d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:11.349518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d2821ffa-9c1d-401d-99b0-edf8d80fad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:11.417514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:11.465971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:07:11.748632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:11.750291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:11.916852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6037db-26b0-47b2-8b31-ef259d3a61dc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:12.006635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:12.049942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:12.050560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:12.050840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:12.051108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:12.052842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:12.149320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:12.151303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82273ee-3f36-402e-b433-9567e930ccf8 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:12.169702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 703/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:13.058386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:13.059023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:13.059023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:13.060399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:13.066040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aca8a-a4b8-4414-bb85-4e77e8c3457a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:13.066510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aca8a-a4b8-4414-bb85-4e77e8c3457a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:13.066612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aca8a-a4b8-4414-bb85-4e77e8c3457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:13.149481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b70aca8a-a4b8-4414-bb85-4e77e8c3457a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:13.151065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b70aca8a-a4b8-4414-bb85-4e77e8c3457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:13.179750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:13.266039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:13.420675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:13.422162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:13.584618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9843a-8ca7-4533-95bf-1df7bf89499e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:13.627543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:13.705734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:13.706252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:13.706533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:13.706800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:13.708537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:13.800835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:13.802518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83795d-033a-4531-968b-1c0a339f7948 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:13.822327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 715/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:14.705350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:14.705968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:14.705968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:14.710664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:14.712629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319789a-b6bf-4327-b9e8-72cb57c1ccca None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:14.713089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319789a-b6bf-4327-b9e8-72cb57c1ccca None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:14.713232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319789a-b6bf-4327-b9e8-72cb57c1ccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:14.772050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:14.794880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2319789a-b6bf-4327-b9e8-72cb57c1ccca None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:14.796137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2319789a-b6bf-4327-b9e8-72cb57c1ccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:14.896802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:15.050034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:15.051778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:15.217092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770502-7f53-4b65-b78e-66b8bdf18cbe None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:15.230057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:15.335804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:15.336423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:15.336700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:15.336966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:15.338596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:15.440507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:15.442086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc0281-8294-46ca-a3e6-2a05dd12c288 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:15.463088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 706/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:16.345953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:16.346686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:16.346686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:16.348672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:16.354581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e953d8-5ece-4e4d-920b-4e7493eb58aa None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:16.355153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e953d8-5ece-4e4d-920b-4e7493eb58aa None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:16.355153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e953d8-5ece-4e4d-920b-4e7493eb58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:16.378889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:16.442733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-46e953d8-5ece-4e4d-920b-4e7493eb58aa None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:16.444027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-46e953d8-5ece-4e4d-920b-4e7493eb58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:16.562476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:16.715755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:16.717310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:16.841012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:16.884925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532455-7166-425c-bbad-167599fa2cb8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:17.010249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:17.010863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:17.011144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:17.011454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:17.013104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:17.102608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:17.119035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:17.120755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a237f0-650e-4bfc-bd70-a8b9d0bb5396 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:17.143000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 718/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:18.000263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:18.000897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:18.000897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:18.002167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:18.007378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef074-3cb1-4595-a402-ab8fef93dcb0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:18.007856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef074-3cb1-4595-a402-ab8fef93dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:18.007961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef074-3cb1-4595-a402-ab8fef93dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:18.088153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e48ef074-3cb1-4595-a402-ab8fef93dcb0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:18.089373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e48ef074-3cb1-4595-a402-ab8fef93dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:18.193005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:18.342227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:18.343705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:18.433319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:18.495693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec28b-e4d5-426c-a549-f53c9493ca9d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:18.617912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:18.618535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:18.618833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:18.619101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:18.620753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:18.672228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:18.716201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:18.717881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f76bbd-478b-448f-a8b0-a2d789d467a2 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:18.736702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 709/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:19.534064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:19.534657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:19.534657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:19.536106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:19.541288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fd6b-213a-41e7-a51f-5e43c5e713f8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:19.541756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fd6b-213a-41e7-a51f-5e43c5e713f8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:19.541850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fd6b-213a-41e7-a51f-5e43c5e713f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:19.626915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3b78fd6b-213a-41e7-a51f-5e43c5e713f8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:19.628169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b78fd6b-213a-41e7-a51f-5e43c5e713f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:19.732752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:19.881822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:19.883383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:19.938797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:20.041055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5fe6c-49bb-4bf5-822b-439ac5b9af6b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:20.158031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:20.158546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:20.158819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:20.159086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:20.160726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:20.167826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:20.260151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:20.261799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56343dd1-ccba-45e7-9d51-08188a6195ad service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:20.281319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 721/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:21.085014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:21.085534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:21.085534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:21.086944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:21.092643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c455a-f6bc-42e6-9f0c-37248ad31c20 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:21.093149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c455a-f6bc-42e6-9f0c-37248ad31c20 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:21.093253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c455a-f6bc-42e6-9f0c-37248ad31c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:21.181044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-974c455a-f6bc-42e6-9f0c-37248ad31c20 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:21.182296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-974c455a-f6bc-42e6-9f0c-37248ad31c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:21.268558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:21.304021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:21.455242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:21.456784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:21.475829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:21.620290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fe4a-ce9c-4e1b-a551-36491de6c342 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:21.714801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:21.744020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:21.744926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:21.745343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:21.745752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:21.748306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:21.844441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:21.846102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf312d-dcc1-47e7-a342-bd3196d7fc49 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:21.865417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 712/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:22.661171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:22.661639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:22.661756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:22.663117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:22.668045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44895d4-087e-4fc0-9205-52f7ae6b1a29 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:22.668479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44895d4-087e-4fc0-9205-52f7ae6b1a29 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:22.668591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44895d4-087e-4fc0-9205-52f7ae6b1a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:22.745256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f44895d4-087e-4fc0-9205-52f7ae6b1a29 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:22.746466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f44895d4-087e-4fc0-9205-52f7ae6b1a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:22.805597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:22.873664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:23.029540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:23.031115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:23.196128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02227ba5-8ef8-4286-8ab4-b2eb292991bb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:23.255111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:23.319429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:23.320041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:23.320317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:23.320589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:23.322227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:23.422481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:23.424362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da94128-5a55-4c1d-8f9a-88b71773d908 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:23.445289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 724/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:24.276576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:24.277191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:24.277191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:24.278449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:24.283770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931fb2-7e3f-4b3b-897f-6bfb098e65f6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:24.284209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931fb2-7e3f-4b3b-897f-6bfb098e65f6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:24.284311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931fb2-7e3f-4b3b-897f-6bfb098e65f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:24.365459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ad931fb2-7e3f-4b3b-897f-6bfb098e65f6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:24.366752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad931fb2-7e3f-4b3b-897f-6bfb098e65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:24.368905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:24.481216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:24.631818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:24.633350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:24.808152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9027dc-4e0c-4adf-b31d-72a4e3adb697 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:24.841196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:24.939857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:24.940359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:24.940642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:24.940918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:24.942572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:25.054318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:25.055986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa2447-7f99-4129-9ec6-acceb9c2f816 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:25.074368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 715/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:26.925041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:26.925600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:26.925600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:26.926895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:26.932980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8b56-055f-4ac8-96b6-0469b05363b2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:26.933475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8b56-055f-4ac8-96b6-0469b05363b2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:26.933578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8b56-055f-4ac8-96b6-0469b05363b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:26.978855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:27.008586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3b0c8b56-055f-4ac8-96b6-0469b05363b2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:27.009819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b0c8b56-055f-4ac8-96b6-0469b05363b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:27.120798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:27.404581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:27.406162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:27.527534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a046-34e7-4711-b57a-715b3f0031f5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:27.564139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:27.612634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:27.613268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:27.613548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:27.613939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:27.615758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:27.735331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:27.736695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d8db4-7148-4295-84a4-325befe231dd service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:27.755636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 727/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:29.834352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:29.834961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:29.834961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:29.836360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:29.843099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acb6a-41ab-475c-bf2e-7d3057f9e831 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:29.843726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acb6a-41ab-475c-bf2e-7d3057f9e831 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:29.843726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acb6a-41ab-475c-bf2e-7d3057f9e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:29.914915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-484acb6a-41ab-475c-bf2e-7d3057f9e831 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:29.916112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-484acb6a-41ab-475c-bf2e-7d3057f9e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:29.930242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:30.038919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:30.315998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:30.317572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:30.429897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed746d9-64ab-44b9-8ca8-03e724a6d77f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:30.448359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:30.525715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:30.526333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:30.526612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:30.526876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:30.528540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:30.658476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:30.659978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079648-860a-472b-81fa-65bfd5a72212 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:30.681544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 718/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:32.924391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:32.924928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:32.924928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:32.926198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:32.931972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09171fd-8f93-4cd4-98ef-ec599a999a8a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:32.932416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09171fd-8f93-4cd4-98ef-ec599a999a8a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:32.932508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09171fd-8f93-4cd4-98ef-ec599a999a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:32.984067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:33.002811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d09171fd-8f93-4cd4-98ef-ec599a999a8a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:33.004058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d09171fd-8f93-4cd4-98ef-ec599a999a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:33.118459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:07:33.399975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:33.402679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:33.531399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b04f5f-dfee-4500-914e-adc87a87bf49 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:33.573143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:33.619846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:33.620472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:33.620749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:33.621012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:33.622623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:33.739515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:33.740906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09550bac-89d9-4444-ad07-c0b0e4635a7f service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:33.759456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 730/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:35.804602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:35.805219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:35.805219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:35.806531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:35.812785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e48f3-981e-4e3d-9b35-4e327dc04b8d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:35.813384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e48f3-981e-4e3d-9b35-4e327dc04b8d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:35.813384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e48f3-981e-4e3d-9b35-4e327dc04b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:35.882705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-345e48f3-981e-4e3d-9b35-4e327dc04b8d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:35.883885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-345e48f3-981e-4e3d-9b35-4e327dc04b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:35.906444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:35.993745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:36.291033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:36.292669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:36.404863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a089-8228-4d52-ad7c-d79351832fa4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:36.428570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:36.488417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:36.489045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:36.489322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:36.489587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:36.491367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:36.613351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:36.614852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e7e7a-612f-49d6-b270-d4e22b52ec35 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:36.635445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 721/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:38.608795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969870f3-2067-423f-a384-a504857c9990 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:38.609341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969870f3-2067-423f-a384-a504857c9990 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:38.609341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969870f3-2067-423f-a384-a504857c9990 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:38.610759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:38.617047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94e5e-21a1-412f-a5aa-d10430d5ef4d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:38.617492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94e5e-21a1-412f-a5aa-d10430d5ef4d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:38.617492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe94e5e-21a1-412f-a5aa-d10430d5ef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:38.692103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:38.695773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dfe94e5e-21a1-412f-a5aa-d10430d5ef4d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:38.697584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dfe94e5e-21a1-412f-a5aa-d10430d5ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:38.807577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:07:39.090910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969870f3-2067-423f-a384-a504857c9990 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:39.092663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-969870f3-2067-423f-a384-a504857c9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:39.210545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969870f3-2067-423f-a384-a504857c9990 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:39.267472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:39.295502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:39.296124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:39.296406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:39.296681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:39.298366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:39.417744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:39.419109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212bda-4c65-4fbc-9985-3a36f51f239b service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:39.438907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 733/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:41.392719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:41.393605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:41.393605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:41.395939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:41.402058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97299be-a009-400d-a51e-473ed026f4e1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:41.402499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97299be-a009-400d-a51e-473ed026f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:41.402602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97299be-a009-400d-a51e-473ed026f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:41.473812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f97299be-a009-400d-a51e-473ed026f4e1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:41.475143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f97299be-a009-400d-a51e-473ed026f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:41.504467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:41.580019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:41.865862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:41.868545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:41.991736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbf05d-0e92-4133-962b-16a2eb951431 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:42.020470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:42.067059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:42.067708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:42.067981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:42.068244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:42.069956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:42.192690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:42.194300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650bfaf-0faa-49c4-bf17-98c61e360d46 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:42.212654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 724/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:44.182530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:44.183421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:44.183421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:44.185584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:44.193865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521c58-3313-424e-9a13-0fba8fc6d958 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:44.194337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521c58-3313-424e-9a13-0fba8fc6d958 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:44.194449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8521c58-3313-424e-9a13-0fba8fc6d958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:44.266913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e8521c58-3313-424e-9a13-0fba8fc6d958 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:44.268167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e8521c58-3313-424e-9a13-0fba8fc6d958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:44.277292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:44.369215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:44.646044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:44.647704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:44.770096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce817e-5fba-4dc5-97cc-9c353e37ef72 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:44.830905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:44.850060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:44.850711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:44.850984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:44.851284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:44.852903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:45.102833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:45.104310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c48fa-c207-412c-ad23-79ae4d743bdf service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:45.123062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 736/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:47.071957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:47.072404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:47.072509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:47.073837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:47.079309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09151-7008-4b24-aa67-1dadf0a77f7f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:47.079743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09151-7008-4b24-aa67-1dadf0a77f7f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:47.079850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09151-7008-4b24-aa67-1dadf0a77f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:47.148778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d8f09151-7008-4b24-aa67-1dadf0a77f7f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:47.149989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d8f09151-7008-4b24-aa67-1dadf0a77f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:47.191144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:47.253289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:47.534989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:47.537569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:47.655940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb37af-0e91-4387-9633-b630f73a1d39 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:47.694542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:47.738215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:47.739028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:47.739446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:47.739780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:47.742160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:47.861480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:47.862857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc350d3-cd45-4331-8ac9-9a4bfb61d671 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:47.881323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 727/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:49.767762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:49.768395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:49.768395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:49.769636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:49.775224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be6a-4647-467f-8a36-4d3c995f5445 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:49.775986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be6a-4647-467f-8a36-4d3c995f5445 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:49.776106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294be6a-4647-467f-8a36-4d3c995f5445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:49.847244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3294be6a-4647-467f-8a36-4d3c995f5445 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:49.848377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3294be6a-4647-467f-8a36-4d3c995f5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:49.871205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:49.959115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:50.246207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:50.248584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:50.360664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f09cb2-147b-43ae-a542-7611b9a3501a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:50.440549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:50.447840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:50.448475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:50.448750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:50.449019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:50.450615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:50.564787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:50.566234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98919a-aacd-4701-be72-aeefc17df802 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:50.585336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 739/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:07:52.485064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:52.485974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:52.485974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:52.488229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:07:52.497526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bff4e-d9f9-4357-9eeb-224c6ce0acd6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:52.498280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bff4e-d9f9-4357-9eeb-224c6ce0acd6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:52.498445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bff4e-d9f9-4357-9eeb-224c6ce0acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:52.569307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-658bff4e-d9f9-4357-9eeb-224c6ce0acd6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:07:52.570530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-658bff4e-d9f9-4357-9eeb-224c6ce0acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:52.622883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:52.678455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:07:52.965907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:07:52.968494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:53.079214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5918f79-1b30-4437-a162-74eaaed8b706 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:07:53.128380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:07:53.157529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:07:53.158143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:07:53.158420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:07:53.158692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:07:53.160357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:07:53.286119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:07:53.287987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d11270-e74b-44db-8c5e-d2e5d615d187 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:07:53.307523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 730/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:02.675665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=22 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:03.304790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=66 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:12.690994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82283f-9ec0-4857-bd4e-0b10d9ad7485 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:12.691967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82283f-9ec0-4857-bd4e-0b10d9ad7485 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:12.691967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82283f-9ec0-4857-bd4e-0b10d9ad7485 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:12.693915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 741/1471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:12.699575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7196-1aad-405b-9d54-a5f57a991941 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:12.700107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7196-1aad-405b-9d54-a5f57a991941 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:12.700107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7196-1aad-405b-9d54-a5f57a991941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:12.768927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8e4c7196-1aad-405b-9d54-a5f57a991941 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:12.770141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8e4c7196-1aad-405b-9d54-a5f57a991941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:12.871309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 731/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:13.177716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:13.177985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:13.178263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:13.179785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 742/1473] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 24 13:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:13.184829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a561-b61f-4cbe-b700-885f58551057 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:13.185092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a561-b61f-4cbe-b700-885f58551057 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:13.185362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a561-b61f-4cbe-b700-885f58551057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:13.263358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-34d9a561-b61f-4cbe-b700-885f58551057 None None] MFA Rules not processed for user `6c2ed0e5eabf49d2816ab27e21e54985`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:13.264572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-34d9a561-b61f-4cbe-b700-885f58551057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:13.286106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:13.357102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 732/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 24 13:08:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:13.364829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:13.366368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:13.470731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30628a3-c0c0-4f52-a86a-5da333500bf6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:13.544835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:13.545447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:13.545722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:13.545989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:13.547604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:13.601851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:13.661517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:13.663001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e46bf-07bc-49c6-878c-5e97b1e22741 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:13.682192 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 743/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:15.640261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:15.640815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:15.640815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:15.642816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 733/1476] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:15.651068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bf94-fd86-41a7-b453-781b2ff00ee5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:15.651566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bf94-fd86-41a7-b453-781b2ff00ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:15.651675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99bf94-fd86-41a7-b453-781b2ff00ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:15.719149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0a99bf94-fd86-41a7-b453-781b2ff00ee5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:15.720401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0a99bf94-fd86-41a7-b453-781b2ff00ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:15.826640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 744/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:08:16.097965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:16.099593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:16.231046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189796b-54ee-456e-99c2-6241fee44cd3 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:16.282945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:16.333580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:16.334197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:16.334469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:16.334733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:16.335425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:16.337255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:08:16.337255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:08:16.337255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:08:16.338399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f414-5ad8-4ddf-892f-5b13d8a61bb7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:16.360363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 734/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 13:08:16 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:08:18.269615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:18.270532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:18.270532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:18.272342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 745/1479] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:18.278022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eee89-888a-4353-ace0-b5a281e8cdfc None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:18.278479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eee89-888a-4353-ace0-b5a281e8cdfc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:18.278584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eee89-888a-4353-ace0-b5a281e8cdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:18.348476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c52eee89-888a-4353-ace0-b5a281e8cdfc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:18.349612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c52eee89-888a-4353-ace0-b5a281e8cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:18.448793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 735/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:18.746561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:18.749038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:18.762195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:18.919149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117d763-053c-4427-885e-b7545bd8f37c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:19.014451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:19.048163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:19.048790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:19.049070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:19.049341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:19.051056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:19.144069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:19.145680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97cc93-be1a-4296-bbed-8af2d7c02629 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:19.164678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 746/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:21.235580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:21.236423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:21.236423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:21.238594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 736/1482] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:21.245136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9756-9d66-42e0-8300-28f3624bf0c0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:21.245932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9756-9d66-42e0-8300-28f3624bf0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:21.245932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9756-9d66-42e0-8300-28f3624bf0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:21.317807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-582e9756-9d66-42e0-8300-28f3624bf0c0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:21.319069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-582e9756-9d66-42e0-8300-28f3624bf0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:21.367851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:21.420515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 747/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:08:21.712155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:21.713748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:21.738619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:21.824632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2108-6334-4cb4-a950-42f4b68f9b4f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:21.912642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:21.913250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:21.913528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:21.913799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:21.915462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:22.012602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:22.052035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:22.053548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d03aea-2e24-45e9-b6b5-2b06a7d81cb7 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:22.073847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 737/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:24.022337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:24.023024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:24.023024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:24.024299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 748/1485] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:24.031513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798998a-c916-42fa-887f-3ea049c2c79d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:24.034014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798998a-c916-42fa-887f-3ea049c2c79d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:24.034014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798998a-c916-42fa-887f-3ea049c2c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:24.111281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f798998a-c916-42fa-887f-3ea049c2c79d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:24.113182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f798998a-c916-42fa-887f-3ea049c2c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:24.220874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 738/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:24.506811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:24.508491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:24.617052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983263-761c-4e5e-9e10-63cd4ab5dcc2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:24.694184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:24.696345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:24.697009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:24.697289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:24.697561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:24.700087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:24.812291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:24.813646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9376e-a9e2-4f37-99fb-a6cfe66b0dfd service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:24.831868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 749/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:26.826015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:26.826611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:26.826611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:26.828778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 739/1488] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:26.837486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b75d-937a-46d1-9d42-8355e027bbbc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:26.838262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b75d-937a-46d1-9d42-8355e027bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:26.838262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2b75d-937a-46d1-9d42-8355e027bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:26.922128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-95a2b75d-937a-46d1-9d42-8355e027bbbc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:26.923296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-95a2b75d-937a-46d1-9d42-8355e027bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:26.981849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:27.035933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 750/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:27.324278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:27.326272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:27.367406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:27.440590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82c058-1951-42fa-9d61-417c5cfb0680 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:27.535893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:27.537232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:27.537513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:27.537783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:27.539499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:27.627414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:27.658874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:27.660399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee6b7-4cf9-4d3b-b207-b752de613a31 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:27.678603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 740/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:08:29.853879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:29.854748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:29.854748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:29.856924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 751/1491] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 13:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:08:29.865977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9e1c0-4dad-4e52-a15e-d76e63ce95ab None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:29.866389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9e1c0-4dad-4e52-a15e-d76e63ce95ab None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:29.866512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9e1c0-4dad-4e52-a15e-d76e63ce95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:29.938662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-09f9e1c0-4dad-4e52-a15e-d76e63ce95ab None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:08:29.939898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-09f9e1c0-4dad-4e52-a15e-d76e63ce95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:30.041953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 741/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:08:30.333754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:08:30.335313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:30.452171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d9b2-95a8-448d-abc2-a7ec9c05d886 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:08:30.534208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:08:30.535003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:08:30.535335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:08:30.535659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:08:30.537772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:08:30.547070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:30.651997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:08:30.653452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79075a70-4ff8-42ec-9e3b-d3822a218e97 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:08:30.671833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 752/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:08:40.040103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=82 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:08:40.669463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=50 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:48.549175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:48.549818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:48.549818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:48.634385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:09:48.635761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:48.737600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 742/1494] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:09:48.746359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:48.746874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:48.746874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:48.828647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:09:48.829843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:48.930679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 753/1495] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:09:48.935944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:48.937186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:48.949506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d2de-7bfd-438e-add1-253e93721b1d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.024482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:49.061709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.062461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.062897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.063215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.064024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:09:49.064396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.065490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.065490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:09:49.065490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:09:49.066447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:49.078447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 743/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:09:49.087039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:49.096567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b39140-1094-4699-b3b4-7d33f376605b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.162490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:49.195984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.196584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.196861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.197117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.197746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.199570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.199570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:09:49.199570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:09:49.200740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:49.260581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 754/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:09:49 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:09:49.266547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:49.268199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:49.312284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff0651-2956-4c26-91e9-855005d0bf60 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.425348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.425877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.426157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.426427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.427055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.428118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.428118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:09:49.428118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:09:49.429340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:49.475694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 744/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:09:49 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:09:49.480097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:49.481640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:49.546685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72478-d031-4ec1-8b1e-c10dcd6ae32f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.639999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:49.650691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.651732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.652002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.652268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.652901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.653932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.653932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:09:49.653932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:09:49.654809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:49.667300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 755/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:09:49.671546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:49.673083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:49.684466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d876b-5f43-43fa-938f-84ba8d53d2a7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.708975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:49.782252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.782854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.783143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.783431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.784083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.785147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.785147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:09:49.785147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:09:49.786039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94344-e80f-4113-8da3-4dc3ddc39293 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:49.799425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 745/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:09:49.804120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:49.805669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:49.843545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758dd9f-06ca-49a1-9b4a-2082caf9ee6f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:49.943883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:49.944463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:49.944738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:49.944996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] PATH_INFO: `/v3/projects/aec9d69afd934589ac754bc03337a6a7/users/e85d0d3bab09473fab0da26c60bef836/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:49.978491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec9d69afd934589ac754bc03337a6a7, user_id=e85d0d3bab09473fab0da26c60bef836, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:49.980082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:49.980082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:09:49.980082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:09:49.982227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcedb08-104a-44b7-8342-ff00d61252d1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:50.009603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 756/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:09:49 2022] PUT /identity/v3/projects/aec9d69afd934589ac754bc03337a6a7/users/e85d0d3bab09473fab0da26c60bef836/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:09:50.022080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968624-57c9-4cb6-85c2-4ca5148951eb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.022366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968624-57c9-4cb6-85c2-4ca5148951eb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.022635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41968624-57c9-4cb6-85c2-4ca5148951eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.082217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-41968624-57c9-4cb6-85c2-4ca5148951eb None None] MFA Rules not processed for user `e85d0d3bab09473fab0da26c60bef836`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:09:50.083450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-41968624-57c9-4cb6-85c2-4ca5148951eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:50.171980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 746/1502] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:09:50.188965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.189306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.189672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.191769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 757/1503] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 24 13:09:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:09:50.196942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99eaf5-81a0-4618-8975-3fcdb9da95ad None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.197166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99eaf5-81a0-4618-8975-3fcdb9da95ad None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.197456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99eaf5-81a0-4618-8975-3fcdb9da95ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.231123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:50.276800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-7a99eaf5-81a0-4618-8975-3fcdb9da95ad None None] MFA Rules not processed for user `b99f8096be0f41399f34257c8a1cd5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:09:50.278033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7a99eaf5-81a0-4618-8975-3fcdb9da95ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:50.353526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 747/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 24 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:09:50.361920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:50.363490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:50.414802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:50.475382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846508-372a-4550-aa51-0ec7ac4eed7a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:50.561037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:50.561638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.561914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.562177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.563793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:50.670289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:50.672327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:50.676563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:50.690713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 758/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:09:50.737438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df53-11e2-4949-a5e8-0e81262da6f3 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.737897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df53-11e2-4949-a5e8-0e81262da6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.737992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8df53-11e2-4949-a5e8-0e81262da6f3 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.739293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 748/1506] 10.222.0.47 () {52 vars in 830 bytes} [Wed Aug 24 13:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:09:50.742880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:50.744142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:50.849949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758de794-d73f-4848-b09d-ad11a3bd63af service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:50.959908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:50.960543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:50.960810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:50.961104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] PATH_INFO: `/v3/users/e85d0d3bab09473fab0da26c60bef836` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:50.973809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85d0d3bab09473fab0da26c60bef836)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:50.974857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:50.974857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:09:50.974857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:09:50.976104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:50.985894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:51.048794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85d0d3bab09473fab0da26c60bef836'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:51.049307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85d0d3bab09473fab0da26c60bef836'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:51.049725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85d0d3bab09473fab0da26c60bef836'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:51.062271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85d0d3bab09473fab0da26c60bef836'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:51.078307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85d0d3bab09473fab0da26c60bef836'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:51.109777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 759/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:09:50 2022] DELETE /identity/v3/users/e85d0d3bab09473fab0da26c60bef836 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:09:51.114308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:51.114592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:51.114858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:51.173324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:09:51.174568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:51.260152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:51.274400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 749/1508] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:09:51.284768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:51.286030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:51.407200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035a0a3-b98c-49d9-b3ba-5fce1e1d09a8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:51.463615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:09:51.484403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:51.485025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:51.485304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:51.485571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:51.487219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:51.598659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:51.600063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640df1cf-31f5-4c9a-b7b8-8e0f7ef9d6be service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:51.619944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 760/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:09:51.964719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:09:51.966549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:09:51.979600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7f133-7272-4726-82c4-a78f836b2571 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:09:52.081757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:09:52.082398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:09:52.082679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:09:52.082953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] PATH_INFO: `/v3/projects/aec9d69afd934589ac754bc03337a6a7` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:09:52.093300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec9d69afd934589ac754bc03337a6a7)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:09:52.094357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:09:52.094357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:09:52.094357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:09:52.095607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:09:52.156078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec9d69afd934589ac754bc03337a6a7', 'request_id': 'req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:52.172328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec9d69afd934589ac754bc03337a6a7', 'request_id': 'req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:52.180063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec9d69afd934589ac754bc03337a6a7', 'request_id': 'req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:52.215383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] The token cache is being invalidate because project aec9d69afd934589ac754bc03337a6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:09:52.215666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:52.216174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-4e13d5b8-9ea9-4a51-80c8-4acb82b945a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:09:52.217496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 750/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:09:51 2022] DELETE /identity/v3/projects/aec9d69afd934589ac754bc03337a6a7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:10:01.617284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=62 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:10:02.213147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:11:29.747698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:29.748389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:29.748389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:29.749605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:29.754894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9681-e02a-4d51-8632-f9cf68aaa373 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:29.755382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9681-e02a-4d51-8632-f9cf68aaa373 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:29.755490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9681-e02a-4d51-8632-f9cf68aaa373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:29.849665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-817a9681-e02a-4d51-8632-f9cf68aaa373 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:29.850871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-817a9681-e02a-4d51-8632-f9cf68aaa373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:29.965338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:11:30.122091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:30.125851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:30.259364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288933-d4a4-4a06-ba3f-992f96773639 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:30.265660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:30.266261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:30.266539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:30.266803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:30.275445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:30.277376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b311e-722b-475d-b471-865e95dc9775 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:30.286925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 762/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:31.103340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193d46-c6cd-431e-82b2-89c47644f2a4 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:31.103884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193d46-c6cd-431e-82b2-89c47644f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:31.103884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193d46-c6cd-431e-82b2-89c47644f2a4 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:31.105250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:31.110098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931d8d-34b8-4485-91c8-f091a22223ac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:31.110515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931d8d-34b8-4485-91c8-f091a22223ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:31.110642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931d8d-34b8-4485-91c8-f091a22223ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:31.131973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-54931d8d-34b8-4485-91c8-f091a22223ac None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:31.134006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-54931d8d-34b8-4485-91c8-f091a22223ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:31.146817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:31.305649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193d46-c6cd-431e-82b2-89c47644f2a4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:31.322529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193d46-c6cd-431e-82b2-89c47644f2a4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:31.328766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:31.329420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:31.329642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:31.329914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:31.338278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:31.340008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee3ace-de14-42f4-8062-02190fef1ea9 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:31.349296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 753/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:31.561158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ceaf-1145-4e31-a530-c6489459c32e None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:31.561462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ceaf-1145-4e31-a530-c6489459c32e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:31.561693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ceaf-1145-4e31-a530-c6489459c32e None None] PATH_INFO: `/v3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:31.562970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 764/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 24 13:11:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:11:31.570160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154358-8cda-4e08-b65c-323ebb89cd8c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:31.570441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154358-8cda-4e08-b65c-323ebb89cd8c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:31.570709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154358-8cda-4e08-b65c-323ebb89cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:31.635097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9b154358-8cda-4e08-b65c-323ebb89cd8c None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:31.636371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9b154358-8cda-4e08-b65c-323ebb89cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:31.653917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:11:31.710437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 754/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 13:11:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:40.866072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf759-0275-4fce-aac7-c2080bbba366 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:40.866653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf759-0275-4fce-aac7-c2080bbba366 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:40.866653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf759-0275-4fce-aac7-c2080bbba366 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:40.868130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 765/1519] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 24 13:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:40.873636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea277e7-1b2f-4936-896b-ff93d3d43176 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:40.874108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea277e7-1b2f-4936-896b-ff93d3d43176 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:40.874294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea277e7-1b2f-4936-896b-ff93d3d43176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:40.895906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4ea277e7-1b2f-4936-896b-ff93d3d43176 None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:40.897118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4ea277e7-1b2f-4936-896b-ff93d3d43176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:40.907581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 755/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 24 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:40.915431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf759-0275-4fce-aac7-c2080bbba366 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:40.930702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf759-0275-4fce-aac7-c2080bbba366 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:40.936959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:40.937564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:40.937847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:40.938116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:40.949379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:40.951896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fadea-ab1d-41e5-a23b-0d94004125fd service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:40.966803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 766/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:42.582565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41f28-1b39-4e92-ac6d-03ccca025a29 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:42.583231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41f28-1b39-4e92-ac6d-03ccca025a29 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:42.583231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41f28-1b39-4e92-ac6d-03ccca025a29 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:42.584496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:42.589557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53a13-b4fa-4b31-8918-f4868a274055 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:42.590032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53a13-b4fa-4b31-8918-f4868a274055 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:42.590146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53a13-b4fa-4b31-8918-f4868a274055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:42.610987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0fb53a13-b4fa-4b31-8918-f4868a274055 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:42.612228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0fb53a13-b4fa-4b31-8918-f4868a274055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:42.621608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:42.777096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41f28-1b39-4e92-ac6d-03ccca025a29 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:42.793279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41f28-1b39-4e92-ac6d-03ccca025a29 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:42.799284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:42.799885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:42.800161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:42.800429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:42.808911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:42.810533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d334-0797-4161-a9bc-0db80098f5d9 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:42.819997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 757/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:43.633216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a227-3c25-4619-9022-2f9c6593ad66 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:43.633740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a227-3c25-4619-9022-2f9c6593ad66 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:43.633740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a227-3c25-4619-9022-2f9c6593ad66 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:43.635104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 13:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:43.640316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa558-39f6-4ef5-9879-84566b8b1eb4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:43.640779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa558-39f6-4ef5-9879-84566b8b1eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:43.640884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa558-39f6-4ef5-9879-84566b8b1eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:43.661007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0a0fa558-39f6-4ef5-9879-84566b8b1eb4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:43.662223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0a0fa558-39f6-4ef5-9879-84566b8b1eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:43.670348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:11:43.818744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a227-3c25-4619-9022-2f9c6593ad66 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:43.835214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a227-3c25-4619-9022-2f9c6593ad66 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:43.841612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:43.842217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:43.842490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:43.842751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:43.851700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:43.853274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70aa2d-e408-48e6-92ef-08fdee5c4707 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:43.863194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 769/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:47.744097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:47.744711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:47.744711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:47.746002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:47.752394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a705f-e871-4890-b8e5-01ea289fb43c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:47.753152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a705f-e871-4890-b8e5-01ea289fb43c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:47.753313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a705f-e871-4890-b8e5-01ea289fb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:47.779041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a49a705f-e871-4890-b8e5-01ea289fb43c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:47.780272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a49a705f-e871-4890-b8e5-01ea289fb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:47.789676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:48.086613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:48.089668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:48.175767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b705-3774-4cd7-9117-c1110f7b9146 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:48.179809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:48.180415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:48.180692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:48.180969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:48.190300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:48.191778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce4c76-14f6-422b-8a99-80fbe1d8b7e6 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:48.201173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 760/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:50.072215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01533-701d-48ea-b0c3-d8502c280c88 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:50.073125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01533-701d-48ea-b0c3-d8502c280c88 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:50.073125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01533-701d-48ea-b0c3-d8502c280c88 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:50.074861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:11:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:50.083240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9161ae-cbdf-40e9-8550-e9d81c6c6b6f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:50.083967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9161ae-cbdf-40e9-8550-e9d81c6c6b6f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:50.084147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9161ae-cbdf-40e9-8550-e9d81c6c6b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:50.108494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-eb9161ae-cbdf-40e9-8550-e9d81c6c6b6f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:50.109712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-eb9161ae-cbdf-40e9-8550-e9d81c6c6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:50.119554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:50.399858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff01533-701d-48ea-b0c3-d8502c280c88 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:50.417514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff01533-701d-48ea-b0c3-d8502c280c88 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:50.423195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:50.423813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:50.424094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:50.424362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:50.434324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:50.435813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61401f10-7670-4cd5-9b1a-89226e88b05a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:50.445601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 772/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:53.985379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:53.986238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:53.986238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:53.988360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:53.994966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8058-bfcb-4ae4-82d8-4e18308520ea None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:53.995718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8058-bfcb-4ae4-82d8-4e18308520ea None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:53.995955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b8058-bfcb-4ae4-82d8-4e18308520ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:54.005263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=81 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:11:54.024436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-507b8058-bfcb-4ae4-82d8-4e18308520ea None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:54.026543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-507b8058-bfcb-4ae4-82d8-4e18308520ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:54.036931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:11:54.593935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:54.596141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:54.670762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:11:54.685624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ba99-4a93-4374-8a8d-bae114452c52 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:54.689614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:54.690229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:54.690521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:54.690784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:54.700114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:54.701609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8f9cb-85c2-458b-8892-12c0de66ba2c service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:54.710967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 763/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:11:56.616149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:56.616586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:56.616674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:56.618047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 13:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:11:56.624139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69eaa-14e3-4c2e-988a-467a57f56f62 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:56.624646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69eaa-14e3-4c2e-988a-467a57f56f62 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:56.624757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69eaa-14e3-4c2e-988a-467a57f56f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:56.645822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b5f69eaa-14e3-4c2e-988a-467a57f56f62 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:11:56.647029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b5f69eaa-14e3-4c2e-988a-467a57f56f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:56.658554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:11:57.209071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:11:57.212044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:11:57.233752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610afc-6f46-44ae-8aa4-bbfad508cf61 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:11:57.237880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:11:57.238485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:11:57.238763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:11:57.239029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:11:57.249116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:11:57.250544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48ada-ec1f-479c-9564-b95940a0ccc6 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:11:57.260514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 775/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:12:06.640990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=11 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:12:07.256155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=8 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:27.667265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:27.669478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:27.669478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:27.700336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:27.701952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:27.714483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 765/1540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:27.722985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:27.724103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:27.724621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:27.750713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:27.752483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:27.766979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 776/1541] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:27.771760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:27.788195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9628cdd-8395-4407-b6a9-ce91880dc0a5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:27.796113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:27.796757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:27.797035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:27.797307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:27.797990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:27.798296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:27.800148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:27.817816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 766/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:27.827874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:27.838883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e662a3a-7943-4ebf-93cf-3bd99f4ccaab None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:27.848180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:27.849265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:27.850325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:27.850877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:27.856121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:27.858793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0c03f-21f9-42cb-b7f8-2a4c18cbe70e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:27.914538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 777/1543] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:27 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:13:27.915817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:27.929491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59299007-21cd-4704-9851-a45b23ed7617 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:27.997369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c067e5-8bb9-47cc-992f-fdbbdcee239d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:27.998041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c067e5-8bb9-47cc-992f-fdbbdcee239d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:27.998575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c067e5-8bb9-47cc-992f-fdbbdcee239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.013261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.013803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.014080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.014349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.014996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.017309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.040315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-76c067e5-8bb9-47cc-992f-fdbbdcee239d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.042458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-76c067e5-8bb9-47cc-992f-fdbbdcee239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.066188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 767/1544] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:27 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:13:28.069113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 778/1545] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:28.070625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.080891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153fcf-68ad-492c-9e89-030f9b8acaf6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.081230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153fcf-68ad-492c-9e89-030f9b8acaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.081500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc153fcf-68ad-492c-9e89-030f9b8acaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.091532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa831f1-e504-4a5e-93f6-09a31420a84f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.108471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.109099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.109378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.109700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.110409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.112094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc897-c38b-481f-ab42-486b9da77c60 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.120300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dc153fcf-68ad-492c-9e89-030f9b8acaf6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.121585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dc153fcf-68ad-492c-9e89-030f9b8acaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.131466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 768/1546] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:28.133150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.133662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.134178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.142172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 779/1547] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.142172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b76d2-124f-4c6a-8842-70924cc739e8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.142172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b76d2-124f-4c6a-8842-70924cc739e8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.142172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b76d2-124f-4c6a-8842-70924cc739e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.164860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.165578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c12b76d2-124f-4c6a-8842-70924cc739e8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.166665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.166791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c12b76d2-124f-4c6a-8842-70924cc739e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.184229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 769/1548] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.186073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 780/1549] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.188111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1bda-a6f0-4af0-b0cd-306db371b829 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.188388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1bda-a6f0-4af0-b0cd-306db371b829 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.188656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed1bda-a6f0-4af0-b0cd-306db371b829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.190938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.206942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d71c8a-aec1-435c-a435-f066f40a9543 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.219248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40342b-f233-4423-9672-139f262333be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.219883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40342b-f233-4423-9672-139f262333be admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.221224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40342b-f233-4423-9672-139f262333be admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.221512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40342b-f233-4423-9672-139f262333be admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.223173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40342b-f233-4423-9672-139f262333be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.225404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40342b-f233-4423-9672-139f262333be admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.231271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9eed1bda-a6f0-4af0-b0cd-306db371b829 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.237258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9eed1bda-a6f0-4af0-b0cd-306db371b829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.247759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 770/1550] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:28.248774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40342b-f233-4423-9672-139f262333be admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.255258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 781/1551] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.256889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b4d8-c690-4893-b72b-5d991e5cec52 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.257458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b4d8-c690-4893-b72b-5d991e5cec52 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.257962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b4d8-c690-4893-b72b-5d991e5cec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.269250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40342b-f233-4423-9672-139f262333be admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.275767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.277019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.277299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.277574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.278227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:28.278527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.280176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.281664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-92d1b4d8-c690-4893-b72b-5d991e5cec52 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.283735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-92d1b4d8-c690-4893-b72b-5d991e5cec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.291679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 782/1552] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.292872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864206-8335-4ed5-96a3-2cf70e24e62d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.293152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864206-8335-4ed5-96a3-2cf70e24e62d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.293418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36864206-8335-4ed5-96a3-2cf70e24e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.297109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 771/1553] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:28.299994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.310672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947001-c76b-4b20-bf7f-af6a62c2965f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.313834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-36864206-8335-4ed5-96a3-2cf70e24e62d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.315086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-36864206-8335-4ed5-96a3-2cf70e24e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.315295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.315944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.316222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.316497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] PATH_INFO: `/v3/projects/81615cadb03e4161a5c3ebda3c79b56c/users/82a5ead415554f9bbe76791633910d32/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.322884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 783/1554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.324187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1db-64bd-4528-a896-3ab5601e5652 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.324473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1db-64bd-4528-a896-3ab5601e5652 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.324741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1db-64bd-4528-a896-3ab5601e5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.335446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81615cadb03e4161a5c3ebda3c79b56c, user_id=82a5ead415554f9bbe76791633910d32, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.336513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:28.336513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:13:28.336513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:13:28.338531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549372-e653-4ea6-8848-57c5c895725e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.344315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6a51d1db-64bd-4528-a896-3ab5601e5652 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.345518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6a51d1db-64bd-4528-a896-3ab5601e5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.353668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 784/1555] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.354860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37e78-718b-4909-aac0-de1185190ccf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.355139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37e78-718b-4909-aac0-de1185190ccf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.355443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb37e78-718b-4909-aac0-de1185190ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.359843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 772/1556] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:28 2022] PUT /identity/v3/projects/81615cadb03e4161a5c3ebda3c79b56c/users/82a5ead415554f9bbe76791633910d32/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:28.361234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.361619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.361871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.375438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-efb37e78-718b-4909-aac0-de1185190ccf None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.376645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-efb37e78-718b-4909-aac0-de1185190ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.383760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.384945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.439056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 785/1557] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.440687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.441123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.441568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.444992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 773/1558] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.445827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.451648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:28.456132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0fcf-500c-4a92-83f7-03a0f4e5463b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.462766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.463408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.463690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.463950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.464607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:28.464913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.466561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.468007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.469376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.477551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 786/1559] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.478140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.486084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 774/1560] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:28.486084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.494144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4f7a7-4094-4399-a153-a2556777618e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.494466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876a1d3-393d-41bf-938d-8902a46087e1 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.499441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.499633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.500052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.500164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.500330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.500437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.500603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.500710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.501238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.501340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:28.501562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.503259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0edf65-e632-4606-99cc-f530176d7d0d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.503388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a57747-ae9f-4366-b80c-db8718117a78 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.516860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 775/1561] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:28.518064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094f0f-95c7-4d1b-b782-b7ea853dc3ca None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.518338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094f0f-95c7-4d1b-b782-b7ea853dc3ca None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.518612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094f0f-95c7-4d1b-b782-b7ea853dc3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.536614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 787/1562] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/projects => generated 357 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:28.537920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.538365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.538637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.568971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] MFA Rules not processed for user `82a5ead415554f9bbe76791633910d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.570202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.618338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:28.648942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 788/1563] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.652959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.665901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-37094f0f-95c7-4d1b-b782-b7ea853dc3ca None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.667169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-37094f0f-95c7-4d1b-b782-b7ea853dc3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.714211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71cd24-d2f2-4dfa-bde0-ed46d81703ac None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.719081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.719718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.719995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.720273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.720987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:28.721288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.722307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:28.722307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:13:28.722307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:13:28.723294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcff67-8682-4966-be4d-c284713d78b9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.726863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 776/1564] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.728255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.728556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.728827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.735419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 789/1565] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:28.736809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.737090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.737345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.748803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.750015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.756373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:28.757542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:28.758123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 777/1566] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.758948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.768678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17c91-e2af-4282-bf4b-6e78f958497f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.769091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 790/1567] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:28.769846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.777880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.778488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.778765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.779007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.779681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.779789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f797-a19d-4945-b9f4-c8a40723f521 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.780722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:28.780722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:13:28.780722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:13:28.781916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.784727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.785323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.785597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.785869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.786478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.788409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.811907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 778/1568] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:28.812729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.816997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 791/1569] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:28.818056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.875588 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f9aba-630a-4799-80a8-f08e8dc5a77d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.879973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdcf8d-ab64-4c73-8b19-d43c5d521ebb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.880316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.880924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.881215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.881478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.882089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.884077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.884939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.885575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.885850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.886120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.886741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.888815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.906079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 779/1570] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:28.906938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.917048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef22993-06d9-4284-9dd9-53ca8dc1750f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.920311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 792/1571] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:28.920984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.923939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.924584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.924863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.925135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.925795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:28.926129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.927807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:28.941140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 780/1572] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:28.942156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:28.952405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db038b1-1a1b-4891-9ef0-16f35743503a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.952598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:28.978081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:28.985854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f88cd-5369-48dc-9698-41c93bd29100 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:28.990688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:28.991411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:28.992054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:28.992412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:28.993123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:28.995111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.011680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.012299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.012575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.012844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.013488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:29.013886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.015508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.024713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 793/1573] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.026346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.027858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 781/1574] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:29.029179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.040571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c990f-1e37-4989-98ce-08defd51f4e5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.092403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d2b96-fb5a-440f-b100-9f3c2df86b23 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.096907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.097216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.097551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.097825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.097942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.098102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.098212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.098384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.098806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.099003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:29.099353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.100678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.100956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.114554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 794/1575] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:29.115463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.125486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 782/1576] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.125924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0be56-762c-4e2c-896e-1e0fe7dbdad1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.126641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.132052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.132655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.132930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.133193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.133825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.134841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:29.134841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:13:29.134841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:13:29.136069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.136567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a18a2-4f8b-4479-a285-6f6ff3e48ab0 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.141123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.141711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.141989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.142263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.142961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.144597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.155834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 783/1577] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.156690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.162158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 795/1578] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.162158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.167622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebfe1d-82df-4321-9775-19190353884d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.170224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0ba9f-342e-40a8-9533-343911866597 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.172828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.173438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.173718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.174085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.174710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.174929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.175547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.175820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.176084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.176670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.176794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.178725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.200444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 784/1579] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 308 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.201356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.209688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 796/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.210479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.215020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89001b0f-05c9-4cf3-a125-ed062944a743 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.269971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.270731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.270966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.271261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.271475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c2db-e9ad-4560-b1e0-5eb177b87e0c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.271888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.273830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.276383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.276991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.277264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.277536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.278158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.280172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.295674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:29.295884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 785/1581] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.296491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.307196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9de6d-792b-4fed-8dc6-590df8766643 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.311708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.312300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.312577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.312844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.312952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 797/1582] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.313497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.313670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.315456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.325113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:29.347504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 786/1583] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.348316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.374561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41022604-7e45-475f-bf6b-4990cd3dfb5b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.409848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b486-efe4-4e4a-8b58-592a325cdfc4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.415792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.416427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.416701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.416967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.417628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.419283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.430744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 787/1584] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.431558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.433410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.434124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.434404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.434675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.435405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.437030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.441233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01f4af-f1a9-4237-af36-74449bd3ee55 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.446627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.450042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 798/1585] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.450232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.450232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.450232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.450477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.450575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.450575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.457567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50f341-dc77-494d-b1e3-51fdb3ed2098 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.460956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 788/1586] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.461721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.465190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.465929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.466321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.466597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.467240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.468817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.471276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c01df-3133-4f79-9db8-04e93c0914ff admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.475884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.476460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.476735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.477006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.477619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.482002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 799/1587] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.482127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.482251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.489933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479e53-80e9-4592-ba10-efbb3c7a3682 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.495081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.495849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.496040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.496293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.496988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.498766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.502852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 789/1588] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.503682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.512558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 800/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.512558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.513508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441a9f-be20-4d47-868f-08049970a36d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.518143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.518733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.519010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.519311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.519933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.520085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3676-51f1-4879-a7cb-8e171609db30 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.521892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.524501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.525082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.525704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.525978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.526600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.528507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.544924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 790/1590] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.545608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.555504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecd48-944d-4c51-b99e-7ef98cc4c25a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.556836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 801/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/users => generated 301 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:29.558029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.564143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.565061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.565443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.565869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] PATH_INFO: `/v3/projects/a75c599f43c947be9ae0fdc408ac4009/users/a728632144354b7395f7bd7fb27b31f9/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.570181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010446-dfef-4f38-9d1e-aab55e5addf2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.578043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.578844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.579451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.579885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.580800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.582634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.584256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75c599f43c947be9ae0fdc408ac4009, user_id=a728632144354b7395f7bd7fb27b31f9, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.587481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.595321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 802/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.595321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.607108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac34ea6-1e5e-42d9-a144-ba3d53308a18 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.617724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 791/1593] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:29 2022] PUT /identity/v3/projects/a75c599f43c947be9ae0fdc408ac4009/users/a728632144354b7395f7bd7fb27b31f9/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:29.617724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.671050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:29.687123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.687787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.688117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.688385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.688994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81afa02-8d5a-4752-a968-04686323362f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.689102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.691146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.695233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.695233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.695233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.695596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] PATH_INFO: `/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd/users/70a6621f56254a6f9b2c9deaeaba2076/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.713068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd41de6a9bc4a4fa468dbe9661cd7dd, user_id=70a6621f56254a6f9b2c9deaeaba2076, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.715965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.717055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 803/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.718059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.726491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:29.729119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010e577-0d8f-4b27-b388-94a085010f1a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.733666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 792/1595] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:29 2022] PUT /identity/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd/users/70a6621f56254a6f9b2c9deaeaba2076/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:29.734501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.790985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.791649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.791934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.792311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.792990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.794704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.802857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b266bf-d830-4117-8d08-b822aedd5a0f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.804908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 804/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.805662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.816478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.817113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.817472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.817788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.818441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.819809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82254017-52ce-4fef-90c7-aed41efa78e2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.820343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.824783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.825468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.825827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.826165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.826877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.828568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.831727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 793/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.836057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.843027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 805/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.844251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.847106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107df8c-9e72-41b7-851a-1a92afcb2474 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.851945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.852578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.852854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.853123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.853764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.854431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e66c6-4137-4792-bca0-6fe582179807 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.855410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdb550-9a2a-42d9-aef4-e4f1a64514b9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.859016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.859689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.859962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.860230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] PATH_INFO: `/v3/projects/57b6b303cfd84f1fa3e29cdad0f1cfa4/users/b9e7353015af44e0bb7b93a56e287b85/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.865752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 794/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:29.867441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.867733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.868001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.876275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b6b303cfd84f1fa3e29cdad0f1cfa4, user_id=b9e7353015af44e0bb7b93a56e287b85, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.878271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.893084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 806/1600] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:29 2022] PUT /identity/v3/projects/57b6b303cfd84f1fa3e29cdad0f1cfa4/users/b9e7353015af44e0bb7b93a56e287b85/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:29.893658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.898377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] MFA Rules not processed for user `a728632144354b7395f7bd7fb27b31f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:29.900851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:29.957277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287016-310f-46e5-924e-e823ff51562c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.961817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.962477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.962750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.963018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] PATH_INFO: `/v3/projects/f63f034745754f019b0d807e663e2774/users/72f072c5cd5d43538aa0106eee042559/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.969414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 795/1601] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:29.970333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:29.980604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88a60b-3aa7-4894-83c1-058a209e0d52 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:29.981535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63f034745754f019b0d807e663e2774, user_id=72f072c5cd5d43538aa0106eee042559, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.984407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.985610 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:29.986207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:29.986665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:29.986944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:29.987633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:29.989590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:29.999110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 807/1602] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:29 2022] PUT /identity/v3/projects/f63f034745754f019b0d807e663e2774/users/72f072c5cd5d43538aa0106eee042559/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.000095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.003636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 796/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:30.003636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.013693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d6ada-0969-4626-87fa-649faac8d60c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.033425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.068508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32fe5b-8e5a-4ebd-9f95-22182bb34b17 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.071757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.072426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.072801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.072983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] PATH_INFO: `/v3/projects/187b3b412da4414091f81d5969926eb0/users/1686820720f24e9aa3b63508b8514367/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.073241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.073852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.074125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.074394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.075033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.076558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.076719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.086734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 808/1604] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:30.087583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.090223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] RBAC: Authorizing `identity:create_grant(project_id=187b3b412da4414091f81d5969926eb0, user_id=1686820720f24e9aa3b63508b8514367, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.093172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.097123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c89d4-0781-48e3-9d9c-fe987cefe278 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.102147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.102755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.103020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.103319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.103954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.105520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45faef9-429e-4806-86e9-f16abf5709e1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.107652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 797/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/187b3b412da4414091f81d5969926eb0/users/1686820720f24e9aa3b63508b8514367/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.111625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.116048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 809/1606] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:30.117205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f0ba-aa1a-4774-be21-e6b8ea9bd426 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.117488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f0ba-aa1a-4774-be21-e6b8ea9bd426 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.117762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620f0ba-aa1a-4774-be21-e6b8ea9bd426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.145310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b620f0ba-aa1a-4774-be21-e6b8ea9bd426 None None] MFA Rules not processed for user `b9e7353015af44e0bb7b93a56e287b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.146525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b620f0ba-aa1a-4774-be21-e6b8ea9bd426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.170050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5979e-96f4-42b7-90f5-fdc8a335033f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.174787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.175422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.175698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.175967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.176704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.178372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.188358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 798/1607] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:30.189143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.198608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eca25-22f9-4b01-850d-79bb7088c040 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.203353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.203969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.204245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.204514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.205187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.207080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.211840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 810/1608] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.213243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.213622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.213993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.233682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.234881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.237781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 799/1609] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:30.241565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.293124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 811/1610] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.293984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.303059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aefb41-7d14-43dc-bfcd-7a5c28a65a43 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.308666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.309320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.309593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.309863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] PATH_INFO: `/v3/projects/5f178f6dad7e4661b5f456339385b329/users/1684906668f04bc985e21078d9057371/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.310680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d9ad8-90ab-4d57-be83-e9ac3b2889b9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.316367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.317136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.317413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.317677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] PATH_INFO: `/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd/users/70a6621f56254a6f9b2c9deaeaba2076/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.319849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd41de6a9bc4a4fa468dbe9661cd7dd, user_id=70a6621f56254a6f9b2c9deaeaba2076, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.322485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddc886-fa2e-477c-a19c-a06119d62fa6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.324214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f178f6dad7e4661b5f456339385b329, user_id=1684906668f04bc985e21078d9057371, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.326846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.334382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 800/1611] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd/users/70a6621f56254a6f9b2c9deaeaba2076/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.335715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.335991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.336417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.344382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 812/1612] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/5f178f6dad7e4661b5f456339385b329/users/1684906668f04bc985e21078d9057371/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.344382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.356469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.357682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.365029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.405141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.408071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56f3d7-011e-44bb-974e-7e5da3c21e5f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.413208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.413874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.414154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.414425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] PATH_INFO: `/v3/projects/2c5f4473449f40b98d1c0e0c13ca0d1f/users/bc188fdd8d7d4697a1203661b7facf1d/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.419739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 801/1613] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.424072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.432797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5f4473449f40b98d1c0e0c13ca0d1f, user_id=bc188fdd8d7d4697a1203661b7facf1d, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.434856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad3177-623e-4000-8cd2-82069de484dd None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.435685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.439660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.440350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.440688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.441048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] PATH_INFO: `/v3/projects/d3eaddd20c364d98b0605083bd013cad/users/aafbd21ddd674002b1d7181e04ff9644/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.450633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 813/1614] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/2c5f4473449f40b98d1c0e0c13ca0d1f/users/bc188fdd8d7d4697a1203661b7facf1d/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.451371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.458204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3eaddd20c364d98b0605083bd013cad, user_id=aafbd21ddd674002b1d7181e04ff9644, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.460922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.476203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 802/1615] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/d3eaddd20c364d98b0605083bd013cad/users/aafbd21ddd674002b1d7181e04ff9644/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:30.477088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.514007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5b7f6-6810-40ca-b909-8361e11e078b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.539009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59b7e7-a1e0-46ef-bdc8-da0381a18987 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.544348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.544995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.545279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.545577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.546342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.548344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.571308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.571874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.572126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.575308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 803/1616] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:30.575444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.575444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.575620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.575732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ef8bc-9f91-4259-9aa9-1f490426405f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.602624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 814/1617] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:30.604156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59921-5bf9-4dd6-aa55-68743ab6a3d3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.604441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59921-5bf9-4dd6-aa55-68743ab6a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.604716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59921-5bf9-4dd6-aa55-68743ab6a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.632254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44ebd-3123-4426-981e-03802cefa568 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.636278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8aa59921-5bf9-4dd6-aa55-68743ab6a3d3 None None] MFA Rules not processed for user `70a6621f56254a6f9b2c9deaeaba2076`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.637583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8aa59921-5bf9-4dd6-aa55-68743ab6a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.657921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.683383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.684094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.684439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.684770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.708554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 815/1618] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.709810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ea996-611a-48d9-a83b-170acfb4ad68 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.710092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ea996-611a-48d9-a83b-170acfb4ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.710363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ea996-611a-48d9-a83b-170acfb4ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.718007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:30.731307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b59ea996-611a-48d9-a83b-170acfb4ad68 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.732521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b59ea996-611a-48d9-a83b-170acfb4ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.753418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.755046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.765065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 804/1619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:30.766003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.775127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b0fe-49fe-4a05-b3e2-a6f1985ea562 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.781133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.781825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.782187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.782561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.793458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 816/1620] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.793680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.794833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.795119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9aecb-6712-4c30-9fee-967372294666 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.795521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.795521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.805857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 805/1621] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:30.807138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.807475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.807748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.816848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.818009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.826233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 817/1622] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.828208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:30.829518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.830188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.840327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acb2b-dc63-4289-b100-4d909ced5644 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.841862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 806/1623] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:30.842915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.845477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.846356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.846691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.847022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.847806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.849828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.854218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f67ee-fdbf-4340-883e-ce091ce64704 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.859797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.860651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.861006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.864532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.864689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 818/1624] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:30.864798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.864896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.864986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.890649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 807/1625] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:30 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:30.891816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.893907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:30.907205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3191-a8c3-460c-9085-706373aa1013 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.911816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.912439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.912761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.913040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.923865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.925490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.933555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8efcd-ca98-426a-bce7-4c6c18e47e33 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.936351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 808/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:30.937815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.938571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.938948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.939530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.944415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.951508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.954163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.958355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a114ad-1a79-4133-a90f-871fb960caed service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.965083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.965716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.966006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.966281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.966875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 819/1627] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:30.967948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:30.977904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42faf0-b26a-4f7c-9154-600b4ed9b576 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:30.978906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.980921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.982327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:30.983010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:30.983417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:30.983786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:30.993948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:30.994448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 809/1628] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:30.995692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:30.995923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.009513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38f519-7bf7-4194-a8c7-ef4496199d9c service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.011110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 820/1629] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:31.013229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.015461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.016103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.016103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.016376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] PATH_INFO: `/v3/projects/dab593f4b5fb43f49e62a301a6a42242/users/e8566431803146f485b1b90b46e99319/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.025744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc98a-bd12-4853-85f4-3d54a6cc0463 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.033373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.035022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.035425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.035796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.036841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.037608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab593f4b5fb43f49e62a301a6a42242, user_id=e8566431803146f485b1b90b46e99319, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.038489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.042117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.055841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 821/1630] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:31.056899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.068699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4bca-d993-49ae-8b18-92ce4bfbc041 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.082312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 810/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:30 2022] PUT /identity/v3/projects/dab593f4b5fb43f49e62a301a6a42242/users/e8566431803146f485b1b90b46e99319/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:31.093642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.113514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:31.175810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.176554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.176894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.177281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] PATH_INFO: `/v3/projects/6e7287f6f69f4ee39cfb043842e40a69/users/15e5c65d10c84080a14aff5512d9d4d5/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.206079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7287f6f69f4ee39cfb043842e40a69, user_id=15e5c65d10c84080a14aff5512d9d4d5, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.209719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.233964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 822/1632] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:31 2022] PUT /identity/v3/projects/6e7287f6f69f4ee39cfb043842e40a69/users/15e5c65d10c84080a14aff5512d9d4d5/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:31.239233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.246748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e8fd0-4d44-4c64-b18d-36a3f7a86a8d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.332150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:31.345322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ae42-d47b-45ae-b1a7-56262811dedc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.354082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.354811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.355345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.355630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.356424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.358289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.358771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.359635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.360471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.360471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.361529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.364430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.375499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 823/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:31.376882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.384280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 811/1634] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:31.384280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.394418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a297822-256a-4265-afcf-5d737a88cb7b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.395767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fade10-d1ae-442f-ac4e-5c5dbc681e6a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.399946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.401666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.402554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.402908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] PATH_INFO: `/v3/projects/6e7287f6f69f4ee39cfb043842e40a69/users/15e5c65d10c84080a14aff5512d9d4d5/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.404428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.405065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7287f6f69f4ee39cfb043842e40a69, user_id=15e5c65d10c84080a14aff5512d9d4d5, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.405217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.405831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.406184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] PATH_INFO: `/v3/users/82a5ead415554f9bbe76791633910d32` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.407683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a5ead415554f9bbe76791633910d32)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.408119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.410213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.446016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 812/1635] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:31 2022] PUT /identity/v3/projects/6e7287f6f69f4ee39cfb043842e40a69/users/15e5c65d10c84080a14aff5512d9d4d5/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:31.447284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.516160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a5ead415554f9bbe76791633910d32'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:31.517072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a5ead415554f9bbe76791633910d32'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:31.518124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a5ead415554f9bbe76791633910d32'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:31.531560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a5ead415554f9bbe76791633910d32'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:31.549227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7574e859-df1e-47f9-a33f-63c7ebdf8912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a5ead415554f9bbe76791633910d32'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:31.560240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae34ff-e3be-45a8-b0a4-43022680ca75 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.565468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.566137 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.566412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.566823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] PATH_INFO: `/v3/projects/dab593f4b5fb43f49e62a301a6a42242/users/e8566431803146f485b1b90b46e99319/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.568860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab593f4b5fb43f49e62a301a6a42242, user_id=e8566431803146f485b1b90b46e99319, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.571788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14992f-6c98-4792-8f3d-e141f6c5d479 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.578201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 824/1636] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:31 2022] DELETE /identity/v3/users/82a5ead415554f9bbe76791633910d32 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:31.580522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.581776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.582470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.595252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 813/1637] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:31 2022] PUT /identity/v3/projects/dab593f4b5fb43f49e62a301a6a42242/users/e8566431803146f485b1b90b46e99319/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:31.595252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5ceda-10ab-4bc4-9174-4e79ea9446da None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.595252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5ceda-10ab-4bc4-9174-4e79ea9446da None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.595252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5ceda-10ab-4bc4-9174-4e79ea9446da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.631109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:31.637475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b0e5ceda-10ab-4bc4-9174-4e79ea9446da None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:31.639035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b0e5ceda-10ab-4bc4-9174-4e79ea9446da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:31.646623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] MFA Rules not processed for user `15e5c65d10c84080a14aff5512d9d4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:31.649610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:31.739962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 814/1638] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:31.740127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.740471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.740749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.779948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] MFA Rules not processed for user `e8566431803146f485b1b90b46e99319`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:31.782153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:31.817391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 825/1639] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:31.821190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.824886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:31.889173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:31.923063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d8af8-8c53-4962-910c-c2dcda12e640 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:31.927899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:31.928771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:31.928906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:31.929356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:31.941998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:31.944281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:31.949847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 815/1640] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:31.951309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.954546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:31.957736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 826/1641] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:31.958608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:31.960185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:32.056539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5aa47-7c9d-4fd8-9b03-7f324f1f249a service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:32.062055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:32.062805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:32.063080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:32.063376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:32.073674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af1dfd-b317-4db8-a3b7-7e6aa4da839d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:32.077163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:32.079111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:32.079509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:32.080339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:32.080828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:32.081282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:32.091148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 827/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:32.102086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:32.103752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:32.125717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 816/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:32.242956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:32.255293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b25603-b541-427f-826f-705fbe78cf1c service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:32.274033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:32.274671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:32.274954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:32.275259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:32.277465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:32.377420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:32.422139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:32.423653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6a87d-3d5c-47fe-92e0-0e2cceb37b20 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:32.448782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 828/1644] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:32.990912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:32.992421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:33.006718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d536d3-b68a-4acd-b648-f42f542c80b2 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:33.012022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:33.012726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:33.012989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:33.013268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] PATH_INFO: `/v3/users/b9e7353015af44e0bb7b93a56e287b85` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:33.014740 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e7353015af44e0bb7b93a56e287b85)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:33.015699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: WARNING py.warnings [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:33.015699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: warnings.warn(msg) Aug 24 13:13:33.015699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: Aug 24 13:13:33.016980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:33.105808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e7353015af44e0bb7b93a56e287b85'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.122650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e7353015af44e0bb7b93a56e287b85'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.137075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e7353015af44e0bb7b93a56e287b85'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.139257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e7353015af44e0bb7b93a56e287b85'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.161959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e7353015af44e0bb7b93a56e287b85'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.170594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 817/1645] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:32 2022] DELETE /identity/v3/users/b9e7353015af44e0bb7b93a56e287b85 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:33.177206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:33.177793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:33.178063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:33.207706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:33.209509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:33.308535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 829/1646] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:33.326203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:33.328891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:33.440034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67518a7a-9ab0-4738-a82c-2b9d1650c311 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:33.446656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:33.447423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:33.447705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:33.447978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:33.475106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:33.476862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5594f-0e70-4968-b180-0eb436527550 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:33.495787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 818/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:33.729275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:33.730852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:33.751710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa5f3a-eb30-43aa-a104-022ab4af6e04 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:33.771992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:33.772186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:33.772542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:33.772835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] PATH_INFO: `/v3/projects/81615cadb03e4161a5c3ebda3c79b56c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:33.774120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81615cadb03e4161a5c3ebda3c79b56c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:33.775204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: WARNING py.warnings [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 13:13:33.775204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: warnings.warn(msg) Aug 24 13:13:33.775204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: Aug 24 13:13:33.776952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:33.848873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:33.849034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:33.849310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:33.962002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:33.974590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81615cadb03e4161a5c3ebda3c79b56c', 'request_id': 'req-32d36c47-0c06-4634-ad06-5a2de76d7de5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:33.999266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] MFA Rules not processed for user `aafbd21ddd674002b1d7181e04ff9644`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:34.000750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.030175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81615cadb03e4161a5c3ebda3c79b56c', 'request_id': 'req-32d36c47-0c06-4634-ad06-5a2de76d7de5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.060293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81615cadb03e4161a5c3ebda3c79b56c', 'request_id': 'req-32d36c47-0c06-4634-ad06-5a2de76d7de5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.080943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] The token cache is being invalidate because project 81615cadb03e4161a5c3ebda3c79b56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:34.081268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.082233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.083808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 830/1648] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:33 2022] DELETE /identity/v3/projects/81615cadb03e4161a5c3ebda3c79b56c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:34.087839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.089301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.157013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 819/1649] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:34.169934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.171136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.226897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d36c47-0c06-4634-ad06-5a2de76d7de5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.233801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.234820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.235343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.236103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] PATH_INFO: `/v3/users/70a6621f56254a6f9b2c9deaeaba2076` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.237763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a6621f56254a6f9b2c9deaeaba2076)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.241745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.249774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:34.311865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee100c-ee84-48df-8ab5-3cb45143d082 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.318374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.320957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.322844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.323535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.324537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.327104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.332418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a6621f56254a6f9b2c9deaeaba2076'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.339429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a6621f56254a6f9b2c9deaeaba2076'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.340340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a6621f56254a6f9b2c9deaeaba2076'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.351616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a6621f56254a6f9b2c9deaeaba2076'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.366534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a6621f56254a6f9b2c9deaeaba2076'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.403100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 820/1650] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:34 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:34.406572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.409906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.430409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 831/1651] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:34 2022] DELETE /identity/v3/users/70a6621f56254a6f9b2c9deaeaba2076 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:34.430409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.430409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.563378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111086d-332f-400d-a004-b498d61c4364 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.573436 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.573862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.574146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.574416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] PATH_INFO: `/v3/projects/57b6b303cfd84f1fa3e29cdad0f1cfa4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.575629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b6b303cfd84f1fa3e29cdad0f1cfa4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.577543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.578665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29edb88-f81a-4c9a-bf9f-f78f620ddc46 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.641848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.641848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.641848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.641848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.642112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.642112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.676619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:34.682595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 832/1652] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:34 2022] POST /identity/v3/users => generated 308 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:34.688024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.720135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e11f8-207f-448d-9a7f-455812654b62 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.757773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b6b303cfd84f1fa3e29cdad0f1cfa4', 'request_id': 'req-95c998e5-c504-4734-9c7f-fa3543f42a8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.779654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b6b303cfd84f1fa3e29cdad0f1cfa4', 'request_id': 'req-95c998e5-c504-4734-9c7f-fa3543f42a8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.788932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b6b303cfd84f1fa3e29cdad0f1cfa4', 'request_id': 'req-95c998e5-c504-4734-9c7f-fa3543f42a8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.819659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] The token cache is being invalidate because project 57b6b303cfd84f1fa3e29cdad0f1cfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:34.821108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.822495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:34.832141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 821/1653] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:34 2022] DELETE /identity/v3/projects/57b6b303cfd84f1fa3e29cdad0f1cfa4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:34.833566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.837501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.913471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.914118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.914524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.914896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.915585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.921871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.950272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 833/1654] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:34.954254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:34.959735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:34.974742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c998e5-c504-4734-9c7f-fa3543f42a8b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:34.980198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:34.980869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:34.981148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:34.981422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] PATH_INFO: `/v3/users/15e5c65d10c84080a14aff5512d9d4d5` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:34.982604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e5c65d10c84080a14aff5512d9d4d5)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:34.985722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:34.990844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f682b-5249-4c44-9f16-69450fcff4fd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:35.008142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:35.008884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:35.009399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:35.009576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] PATH_INFO: `/v3/projects/dd0da5f8b4764f548985d1a2512ca003/users/98c697b066d7437ca35ce3da86df0e9a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:35.020607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:35.058967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0da5f8b4764f548985d1a2512ca003, user_id=98c697b066d7437ca35ce3da86df0e9a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:35.070736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:35.099848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e5c65d10c84080a14aff5512d9d4d5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:35.103600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 834/1655] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:34 2022] PUT /identity/v3/projects/dd0da5f8b4764f548985d1a2512ca003/users/98c697b066d7437ca35ce3da86df0e9a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:35.108353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:35.115554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e5c65d10c84080a14aff5512d9d4d5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:35.132814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e5c65d10c84080a14aff5512d9d4d5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:35.133670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e5c65d10c84080a14aff5512d9d4d5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:35.155110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e5c65d10c84080a14aff5512d9d4d5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:35.168172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 822/1656] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:34 2022] DELETE /identity/v3/users/15e5c65d10c84080a14aff5512d9d4d5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:35.223694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea75f-08cc-4f2b-9360-1d07e2389235 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:35.314659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:35.316318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:35.316792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:35.317449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:35.318413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:35.321196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:35.334461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 835/1657] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:35.338391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:35.339905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:35.360257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bd714-eafc-4a13-9809-76ceb56a6066 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:35.368046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:35.369391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:35.369898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:35.370373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] PATH_INFO: `/v3/projects/dd0da5f8b4764f548985d1a2512ca003/users/98c697b066d7437ca35ce3da86df0e9a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:35.373378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0da5f8b4764f548985d1a2512ca003, user_id=98c697b066d7437ca35ce3da86df0e9a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:35.377485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:35.391635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 823/1658] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:35 2022] PUT /identity/v3/projects/dd0da5f8b4764f548985d1a2512ca003/users/98c697b066d7437ca35ce3da86df0e9a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:35.852999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:35.857236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:35.876390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008ddf2-db99-4359-9e56-d0a7d4e5d9f0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.067420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.070158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.070543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.072386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] PATH_INFO: `/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.077179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd41de6a9bc4a4fa468dbe9661cd7dd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.082550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.084992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:36.095515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.115877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61c114-fc2f-4844-b90e-6ddd79e2df87 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.137736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.140149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.143546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.147165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] PATH_INFO: `/v3/projects/6e7287f6f69f4ee39cfb043842e40a69` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.150883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7287f6f69f4ee39cfb043842e40a69)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.159904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.195400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:36.221722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:36.271877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd41de6a9bc4a4fa468dbe9661cd7dd', 'request_id': 'req-2238f9cc-6161-445b-8b2e-0d14ff65c47b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.299351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd41de6a9bc4a4fa468dbe9661cd7dd', 'request_id': 'req-2238f9cc-6161-445b-8b2e-0d14ff65c47b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.342745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd41de6a9bc4a4fa468dbe9661cd7dd', 'request_id': 'req-2238f9cc-6161-445b-8b2e-0d14ff65c47b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.346299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7287f6f69f4ee39cfb043842e40a69', 'request_id': 'req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.354617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7287f6f69f4ee39cfb043842e40a69', 'request_id': 'req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.361599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7287f6f69f4ee39cfb043842e40a69', 'request_id': 'req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.382568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] The token cache is being invalidate because project 8bd41de6a9bc4a4fa468dbe9661cd7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:36.382874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.384626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2238f9cc-6161-445b-8b2e-0d14ff65c47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.388565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] The token cache is being invalidate because project 6e7287f6f69f4ee39cfb043842e40a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:36.391028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.392220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9ab928aa-b69e-42f2-9ad0-fa6925a9b8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:36.394651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 836/1659] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:35 2022] DELETE /identity/v3/projects/8bd41de6a9bc4a4fa468dbe9661cd7dd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:36.396231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992111-e858-4b7c-8ef9-b45b0bc75430 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.398857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992111-e858-4b7c-8ef9-b45b0bc75430 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.399486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992111-e858-4b7c-8ef9-b45b0bc75430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.401933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 824/1660] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:36 2022] DELETE /identity/v3/projects/6e7287f6f69f4ee39cfb043842e40a69 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:36.404072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678941e-0154-446b-85d3-416a523332ff None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.405818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678941e-0154-446b-85d3-416a523332ff None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.407945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678941e-0154-446b-85d3-416a523332ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.443973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f0992111-e858-4b7c-8ef9-b45b0bc75430 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:36.452476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f0992111-e858-4b7c-8ef9-b45b0bc75430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:36.458301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b678941e-0154-446b-85d3-416a523332ff None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:36.463460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b678941e-0154-446b-85d3-416a523332ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:36.603891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 837/1661] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:36.604252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 825/1662] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:36.610584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.610584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.610584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.613692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.616077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.617595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.664893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:36.666712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:36.676994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:36.680409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:36.686698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 826/1663] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:36.689031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.713437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf026ef-58dc-4205-b357-dae8fc881334 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.715016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 838/1664] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:36.718533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.731892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.732734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.733334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.733760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.735362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:36.735896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.738598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.744599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a222c-684c-44ad-a27f-bb29c6d1039c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.756059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 827/1665] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:36.765922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.768018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.768838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.769629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.771125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.773963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:36.774381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.776480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.806447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832d933-9d95-41a8-b3be-053d66f2da82 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.818831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.819879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.820496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.823143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.828070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 839/1666] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:36.828542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.828542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.829595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.850422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f7f6a-3d03-45e1-9cd2-c86f21639264 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:36.859631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:36.860579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:36.861026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:36.861505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:36.862304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:36.866142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:36.905745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 828/1667] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:36.911500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:36.945070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 840/1668] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:36.947120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.047937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:37.053799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be642-d75c-4c4c-b6a5-fe57e55eb2bc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.103197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a644-4df8-4b2b-8bc0-a40a01423773 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.114574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.116768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.117271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.119724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.120580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.128752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.197812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 841/1669] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:37.200724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.230275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4a08-0560-47f3-b003-0f7ef1bab36c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.235813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.237732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.238942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.239873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.240823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.243850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.245561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.247801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.248225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.249166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.249598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.254300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.260367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:37.285492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 842/1670] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:37.288400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.305942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 829/1671] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:36 2022] POST /identity/v3/users => generated 284 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:37.314219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.323563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f865c5-364e-4f09-ae05-47bd96db41d4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.336964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca3c8-80f1-458b-aa55-b33d47ca7fd3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.337875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.338616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.338996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.339396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.340549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.343004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.353165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.353991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.354374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.354739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.355528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.364292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.367689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 843/1672] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:37.371882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.385284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 830/1673] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:37.393455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.402514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176cbab-895c-4dc9-aef7-e342596437e6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.412889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97920e2-6bdc-4266-86a2-82585281860d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.415001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.415886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.416265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.416639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] PATH_INFO: `/v3/projects/c89778e167ce4ccb8d3ebebc59847ac9/users/95c70acc74fa416081b7a45d2ff6149b/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.427967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.428728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.429110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.429489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.432178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.434244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.453051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89778e167ce4ccb8d3ebebc59847ac9, user_id=95c70acc74fa416081b7a45d2ff6149b, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.457247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c1b4-bf41-4f96-b853-f3e9e0778cb8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.466016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 831/1674] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:37.467360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.485161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba5506-bdce-4826-a2b2-f88357317e9c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.499915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 844/1675] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:37 2022] PUT /identity/v3/projects/c89778e167ce4ccb8d3ebebc59847ac9/users/95c70acc74fa416081b7a45d2ff6149b/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:13:37.506144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.506435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.506716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.593143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] MFA Rules not processed for user `95c70acc74fa416081b7a45d2ff6149b`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:37.596233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:37.662118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.663420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.663951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.665527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] PATH_INFO: `/v3/projects/2aaf25d6768545eeb9f17c6b7a584ab2/users/f2f5b8fa403c4a998d436b122bd8ec7c/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.703729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aaf25d6768545eeb9f17c6b7a584ab2, user_id=f2f5b8fa403c4a998d436b122bd8ec7c, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.711884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ecf3-b7e9-44b5-be3e-642d645c49ad admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.743743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 832/1676] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:37 2022] PUT /identity/v3/projects/2aaf25d6768545eeb9f17c6b7a584ab2/users/f2f5b8fa403c4a998d436b122bd8ec7c/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:37.754517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.754801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.755078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.772303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 845/1677] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:37.777388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:37.805579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b0b9-ad55-4edd-8957-b4a991efcac6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:37.828261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] MFA Rules not processed for user `f2f5b8fa403c4a998d436b122bd8ec7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:37.829831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:37.940581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:37.973997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:37.975670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:37.975891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:37.979310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:37.980480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:37.982506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 833/1678] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:37.985036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:37.987068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.004226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df73cc-ebf6-4df0-8b50-c71a83409140 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.010687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707add87-678b-4087-b328-db3407fde021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.012614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707add87-678b-4087-b328-db3407fde021 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.013006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707add87-678b-4087-b328-db3407fde021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.013375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707add87-678b-4087-b328-db3407fde021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.014311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707add87-678b-4087-b328-db3407fde021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.016950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707add87-678b-4087-b328-db3407fde021 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.052679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 846/1679] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:38.053869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.103721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 834/1680] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:37 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:38.105907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707add87-678b-4087-b328-db3407fde021 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.147803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:38.179978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3baa6-8dd1-4e29-b960-a31c2ea65038 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.273514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707add87-678b-4087-b328-db3407fde021 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.284895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.285710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.286608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.286608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.287436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.290316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.291158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.292071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.292347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.292622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.293276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.299060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.349708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 847/1681] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:38 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:38.353568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.368314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 835/1682] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:38 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:38.369478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.381123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb170eaf-24dd-42f5-8982-b4bfe686c1e0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.394387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148a-141a-42fe-82b7-4b2fff5c599a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.402234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.412403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.412905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.414046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.415527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.418367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.419252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.420013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.422971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.422971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.425208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.429139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.445815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 848/1683] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:38.448849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.456078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 836/1684] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:38.463594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.480969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f07ba-5226-4fa2-92ac-2fb2034cbd3a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.491143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a423-d947-4c4a-a425-025088498651 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.502185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.508234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.508810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.510187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] PATH_INFO: `/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2/users/913d3cd300f14e18bb8d96c30a146cee/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.519033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.521315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.521894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.522609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] PATH_INFO: `/v3/projects/40f95cf921cb4f00a2d28c3fef171b50/users/7f07b93f7f0d4b308e78e7464b2e7904/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.567774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cc332bd6b5459fa6fe386f3236ffa2, user_id=913d3cd300f14e18bb8d96c30a146cee, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.575926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.600957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f95cf921cb4f00a2d28c3fef171b50, user_id=7f07b93f7f0d4b308e78e7464b2e7904, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.604201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.626185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 849/1685] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:38 2022] PUT /identity/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2/users/913d3cd300f14e18bb8d96c30a146cee/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:38.634833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 837/1686] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:38 2022] PUT /identity/v3/projects/40f95cf921cb4f00a2d28c3fef171b50/users/7f07b93f7f0d4b308e78e7464b2e7904/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:38.636337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.638024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.856652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945e8a-dffb-4095-9ab0-d32a043c0e73 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.883765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbef62-a248-4050-98bc-42c97de672e3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.893455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.894383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.894951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.895489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.896343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.898843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.914687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 850/1687] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:38.919292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.936345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.937160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.937601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.938016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.943087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:38.945928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:38.955915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad10f3-99b3-4df0-8a37-bf300dfd4c42 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:38.977822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:38.978596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:38.980234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:38.981143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] PATH_INFO: `/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2/users/913d3cd300f14e18bb8d96c30a146cee/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:38.985258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 838/1688] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:38.989617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:38.990662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cc332bd6b5459fa6fe386f3236ffa2, user_id=913d3cd300f14e18bb8d96c30a146cee, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:39.002370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f18963-b746-40e4-8fbe-97f9b64f1fe8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:39.017464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7e980-20ce-4c9c-a7f8-29490d80753b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:39.055390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 851/1689] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:38 2022] PUT /identity/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2/users/913d3cd300f14e18bb8d96c30a146cee/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:39.057427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5d4b-518d-432f-8d6e-20c62081faae None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.057854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5d4b-518d-432f-8d6e-20c62081faae None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.058226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5d4b-518d-432f-8d6e-20c62081faae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.062802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:39.063573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.063811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.064079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] PATH_INFO: `/v3/projects/40f95cf921cb4f00a2d28c3fef171b50/users/7f07b93f7f0d4b308e78e7464b2e7904/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.067242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f95cf921cb4f00a2d28c3fef171b50, user_id=7f07b93f7f0d4b308e78e7464b2e7904, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:39.077206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ca59-77c8-4900-b752-bd35030ef26d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:39.091883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:39.122791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 839/1690] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:38 2022] PUT /identity/v3/projects/40f95cf921cb4f00a2d28c3fef171b50/users/7f07b93f7f0d4b308e78e7464b2e7904/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:39.124981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.125266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.125539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.159412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1e0c5d4b-518d-432f-8d6e-20c62081faae None None] MFA Rules not processed for user `913d3cd300f14e18bb8d96c30a146cee`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:39.163132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1e0c5d4b-518d-432f-8d6e-20c62081faae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:39.186783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:39.229233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] MFA Rules not processed for user `98c697b066d7437ca35ce3da86df0e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:39.230540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:39.411160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 852/1691] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:39.415894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.417007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.417535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.470119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 840/1692] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:39.471308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:39.473768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:39.500917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] MFA Rules not processed for user `7f07b93f7f0d4b308e78e7464b2e7904`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:39.502940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:39.614149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1980aa-6111-4dcd-887c-5b6cd8522afd None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:39.624477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:39.625243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.625615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.627357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.654435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:39.656053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:39.692131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 841/1693] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:39.726262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:39.734596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 853/1694] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:39.742977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:39.744649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:39.774385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e01ebb-5ad2-44e5-b0d9-d25083c0ba71 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:39.785337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:39.785974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.786318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.786527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.807627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:39.809098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:39.838371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 854/1695] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:39.912940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:39.923020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6e9-bb5b-4c03-b0aa-14ac21bccf52 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:39.928174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ee370-f068-4151-9e62-ec19e943a17c service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:39.938937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:39.940165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.942678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.943125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.949105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:39.949832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:39.950130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:39.950510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] PATH_INFO: `/v3/users/95c70acc74fa416081b7a45d2ff6149b` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:39.952073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c70acc74fa416081b7a45d2ff6149b)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:39.953912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:40.044283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:40.089053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c70acc74fa416081b7a45d2ff6149b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:40.108738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c70acc74fa416081b7a45d2ff6149b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:40.117710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c70acc74fa416081b7a45d2ff6149b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:40.119917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c70acc74fa416081b7a45d2ff6149b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:40.128410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:40.129931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991fc87-450b-481f-9dff-15cbc79efdee service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:40.157099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 855/1696] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:40.159723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c70acc74fa416081b7a45d2ff6149b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:40.172469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 842/1697] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:39 2022] DELETE /identity/v3/users/95c70acc74fa416081b7a45d2ff6149b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:40.177157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:40.177440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:40.177712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:40.210632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:40.211923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:40.235854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:40.377866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 856/1698] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:40.393216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:40.395487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:40.522839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2a9ef-679a-4459-93e8-a8d2d2020143 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:40.539047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:40.540084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:40.544022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:40.544301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:40.578396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:40.583453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:40.625065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 843/1699] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:41.285923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:41.287595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:41.308961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324a3c-cc6a-4113-8413-74a29e913ab6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:41.326697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:41.327422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:41.327700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:41.327968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] PATH_INFO: `/v3/projects/c89778e167ce4ccb8d3ebebc59847ac9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:41.329591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89778e167ce4ccb8d3ebebc59847ac9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:41.331772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:41.400175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89778e167ce4ccb8d3ebebc59847ac9', 'request_id': 'req-e930d9b3-a3bb-471b-ba4d-db72271c6b39'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.408843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89778e167ce4ccb8d3ebebc59847ac9', 'request_id': 'req-e930d9b3-a3bb-471b-ba4d-db72271c6b39'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.420109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89778e167ce4ccb8d3ebebc59847ac9', 'request_id': 'req-e930d9b3-a3bb-471b-ba4d-db72271c6b39'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.438131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] The token cache is being invalidate because project c89778e167ce4ccb8d3ebebc59847ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:41.449539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.450424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e930d9b3-a3bb-471b-ba4d-db72271c6b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.455231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 857/1700] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:41 2022] DELETE /identity/v3/projects/c89778e167ce4ccb8d3ebebc59847ac9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:41.459476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:41.472187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1236a-d09d-4027-a99a-31db102f6e19 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:41.551235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:41.551939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:41.552269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:41.552492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] PATH_INFO: `/v3/users/913d3cd300f14e18bb8d96c30a146cee` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:41.553808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=913d3cd300f14e18bb8d96c30a146cee)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:41.557042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:41.678859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913d3cd300f14e18bb8d96c30a146cee'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.687863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:41.704767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913d3cd300f14e18bb8d96c30a146cee'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.717614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913d3cd300f14e18bb8d96c30a146cee'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.718723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913d3cd300f14e18bb8d96c30a146cee'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.741620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-721d8a3f-2ac5-4488-bc21-337b7d6ba63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913d3cd300f14e18bb8d96c30a146cee'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:41.766567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 844/1701] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:41 2022] DELETE /identity/v3/users/913d3cd300f14e18bb8d96c30a146cee => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:42.546030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:42.546560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:42.546839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:42.549464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 858/1702] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:13:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:42.575599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309eec-346a-4e72-8a3f-e5f5362f29a5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:42.576062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309eec-346a-4e72-8a3f-e5f5362f29a5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:42.576132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309eec-346a-4e72-8a3f-e5f5362f29a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:42.620440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ef309eec-346a-4e72-8a3f-e5f5362f29a5 None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:42.628988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ef309eec-346a-4e72-8a3f-e5f5362f29a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:42.885564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 845/1703] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:43.162285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:43.164113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.231129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f47324-38bd-4761-b961-60ff10e8636e None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.231680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f47324-38bd-4761-b961-60ff10e8636e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.232276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f47324-38bd-4761-b961-60ff10e8636e None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.234385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 846/1704] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 24 13:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:13:43.244531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.244818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.245098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.279463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:43.280820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.294210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 847/1705] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:43.302518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:43.316507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49245d-eb26-43ef-bbb5-e51aeb4b9033 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:43.328527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:43.329260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.331089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.331613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] PATH_INFO: `/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.335153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c5cf5-50d9-4ab4-9a01-5bc216e8b075 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:43.336606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cc332bd6b5459fa6fe386f3236ffa2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:43.339103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:43.346993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:43.348692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.349209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.349923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.364744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:43.368397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0e8f-f954-4e76-b944-75947b136184 service placement] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:43.389516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 848/1706] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:43.442354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:43.462327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cc332bd6b5459fa6fe386f3236ffa2', 'request_id': 'req-4a4a92bc-7464-4029-9ece-9a275abe7bfd'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:43.473735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cc332bd6b5459fa6fe386f3236ffa2', 'request_id': 'req-4a4a92bc-7464-4029-9ece-9a275abe7bfd'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:43.492427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cc332bd6b5459fa6fe386f3236ffa2', 'request_id': 'req-4a4a92bc-7464-4029-9ece-9a275abe7bfd'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:43.516781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] The token cache is being invalidate because project 74cc332bd6b5459fa6fe386f3236ffa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:43.517834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:43.518603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4a4a92bc-7464-4029-9ece-9a275abe7bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:43.524586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 859/1707] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:43 2022] DELETE /identity/v3/projects/74cc332bd6b5459fa6fe386f3236ffa2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:43.527057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c48b5-7a79-4eab-b9fd-aca9a997b169 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.527393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c48b5-7a79-4eab-b9fd-aca9a997b169 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.527668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c48b5-7a79-4eab-b9fd-aca9a997b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.562760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104aa4-dedc-43b9-8335-135e48a32310 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.563333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104aa4-dedc-43b9-8335-135e48a32310 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.563607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104aa4-dedc-43b9-8335-135e48a32310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.605079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e19c48b5-7a79-4eab-b9fd-aca9a997b169 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:43.612782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e19c48b5-7a79-4eab-b9fd-aca9a997b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.635801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-26104aa4-dedc-43b9-8335-135e48a32310 None None] MFA Rules not processed for user `1684906668f04bc985e21078d9057371`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:43.637070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26104aa4-dedc-43b9-8335-135e48a32310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.763305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 860/1708] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:43.780695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 849/1709] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:43.790353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.790837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.792170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.795425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6aff-9bd0-4f69-8d3c-003b328ef5ad None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.795774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6aff-9bd0-4f69-8d3c-003b328ef5ad None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.796172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6aff-9bd0-4f69-8d3c-003b328ef5ad None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.797908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 850/1710] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 13:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:43.825558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.826170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.826656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.835040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:43.836328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.861050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 861/1711] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:43.862104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:43.881906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2555-44fb-4a4a-8a74-0369e2db081a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:43.896031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:43.897064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.897257 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.897538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.898211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:43.898945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:43.901757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:43.916292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:43.917692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:43.927460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 862/1712] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:43.939118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:43.965343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb6e4-10ba-4acc-b8dc-11e2b09b6736 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:43.977031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:43.977681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:43.977963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:43.978291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:43.978947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:43.980943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:43.988469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:44.072186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 863/1713] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:44.078434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:44.079861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 851/1714] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 13:13:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:44.090746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:44.105238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cbc19-13d6-4e89-8a2e-b810c7baa1fe None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:44.223537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6439-ba35-4f29-828a-ae6db7329a68 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:44.265541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:44.271936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.272381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.276272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.278754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:44.283870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:44.284604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.284939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.285279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.289977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:44.390183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 864/1715] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:44 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:44.390183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:44.437452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaacc1-4a0e-4df7-9794-bd92574a278c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:44.456948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:44.457596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.457878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.458238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.458799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:44.460450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:44.471975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:44.473086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:44.476922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:44.504290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 852/1716] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:44.508744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 865/1717] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:44.513448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:44.546062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaac785-6427-42ea-8041-ee48e64fb9f2 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:44.558875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:44.559533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.559816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.560086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.560741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:44.562390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0d58a-a3c8-48da-8634-20c3b6a2e283 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:44.587470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:44.602069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 853/1718] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:44.608655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59ed92-7c35-4378-87b9-b5cd0c3ade01 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:44.629516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:44.630654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.631108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.631597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] PATH_INFO: `/v3/projects/384ff7fec8c94b0894ac1057d6621bfe/users/82fa4b8525af43628ca75d9fd46ed6b8/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.668550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384ff7fec8c94b0894ac1057d6621bfe, user_id=82fa4b8525af43628ca75d9fd46ed6b8, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:44.672514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:44.720130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:44.721334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:44.721749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:44.724640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 866/1719] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:44 2022] PUT /identity/v3/projects/384ff7fec8c94b0894ac1057d6621bfe/users/82fa4b8525af43628ca75d9fd46ed6b8/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:44.785562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] MFA Rules not processed for user `82fa4b8525af43628ca75d9fd46ed6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:44.787118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:44.943963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:45.079254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.081850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 854/1720] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:45.372779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6f01-4db6-47ba-addd-179a00736c36 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:45.396263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:45.396909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.397210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.397459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.398104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:45.400112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf929c8-6d8c-4831-a280-d7397fcfed87 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:45.472964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 867/1721] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:45 2022] POST /identity/v3/projects => generated 379 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:45.474633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.491710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a958-6339-4ce8-9122-480dbcf9fd41 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:45.620372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:45.621210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.621628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.622034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.622816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:45.625297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe9a9e-8836-44de-bcf2-524e2d97b858 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:45.653055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f877df-5d39-4cda-90d2-6a41afea78a9 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.653629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f877df-5d39-4cda-90d2-6a41afea78a9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.653629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f877df-5d39-4cda-90d2-6a41afea78a9 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.655272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 868/1722] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 13:13:45.656474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 855/1723] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:45 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:45.660781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f877df-5d39-4cda-90d2-6a41afea78a9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.668549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.669060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.669482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.690783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f877df-5d39-4cda-90d2-6a41afea78a9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:45.701759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:45.703582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.704117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.704524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.709855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:45.711551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] MFA Rules not processed for user `f703d30d689e4a5983b5d2c39cc68cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:45.711764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:45.714624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:45.735013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 869/1724] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:13:45.736250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.739851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:45.761868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502be1de-d7e2-4580-bb4e-c06acc12cc07 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:45.786688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:45.787612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.788031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.788532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] PATH_INFO: `/v3/users/f2f5b8fa403c4a998d436b122bd8ec7c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.791674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f5b8fa403c4a998d436b122bd8ec7c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:45.793784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:45.823885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 856/1725] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:45.825659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.854397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753591b-ae2e-42c5-9bf6-c3c708809c5f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:45.860297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:45.860952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:45.861272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:45.861613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] PATH_INFO: `/v3/projects/406a9aad6bf44c00853ab72709e7d957/users/233963f89fde42f0b25f0391927c1c76/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:45.884267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=406a9aad6bf44c00853ab72709e7d957, user_id=233963f89fde42f0b25f0391927c1c76, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:45.887470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:45.919453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f5b8fa403c4a998d436b122bd8ec7c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:45.922900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f5b8fa403c4a998d436b122bd8ec7c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:45.923012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 857/1726] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:45 2022] PUT /identity/v3/projects/406a9aad6bf44c00853ab72709e7d957/users/233963f89fde42f0b25f0391927c1c76/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:45.923012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:45.923369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f5b8fa403c4a998d436b122bd8ec7c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:45.928706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:45.940847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f5b8fa403c4a998d436b122bd8ec7c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:45.953897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f5b8fa403c4a998d436b122bd8ec7c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.007763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:46.024111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 870/1727] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:45 2022] DELETE /identity/v3/users/f2f5b8fa403c4a998d436b122bd8ec7c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:46.026110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:46.030635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.050972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e13d4-b774-4a39-8ec7-1be47d3db4af admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:46.066388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:46.175990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f264bcc-26a8-44fd-84f4-c66ddb22ac73 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:46.184153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:46.184823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.185123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.185366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] PATH_INFO: `/v3/users/aafbd21ddd674002b1d7181e04ff9644` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.187074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafbd21ddd674002b1d7181e04ff9644)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:46.190211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:46.193989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:46.194706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.194900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.195194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.198481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.222673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:46.225805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:46.249457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 871/1728] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:46.250421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:46.252120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.288207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a0a33-0bf3-408c-8634-84ee4d1fb96a service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:46.291685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafbd21ddd674002b1d7181e04ff9644'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.301836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:46.302502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.302781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.303566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.304229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:46.306039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ab9f-5a0c-4a12-8e89-1f24c6986acd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:46.311744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafbd21ddd674002b1d7181e04ff9644'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.321895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafbd21ddd674002b1d7181e04ff9644'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.322922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafbd21ddd674002b1d7181e04ff9644'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.337954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 872/1729] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:46.338514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76e57-83bc-4879-a71c-752779bd1549 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.338807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76e57-83bc-4879-a71c-752779bd1549 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.339081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a76e57-83bc-4879-a71c-752779bd1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.353635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafbd21ddd674002b1d7181e04ff9644'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:46.369323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 858/1730] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:45 2022] DELETE /identity/v3/users/aafbd21ddd674002b1d7181e04ff9644 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:46.370255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:46.376313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.387530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d4a76e57-83bc-4879-a71c-752779bd1549 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:46.390529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d4a76e57-83bc-4879-a71c-752779bd1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.537536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c456bcf-b55d-4438-91d6-d0f2c1258749 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:46.551621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 873/1731] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:46.555980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:46.556688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.556974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.557233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] PATH_INFO: `/v3/projects/406a9aad6bf44c00853ab72709e7d957/users/233963f89fde42f0b25f0391927c1c76/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.559988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=406a9aad6bf44c00853ab72709e7d957, user_id=233963f89fde42f0b25f0391927c1c76, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:46.562641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:46.574823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 859/1732] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:46 2022] PUT /identity/v3/projects/406a9aad6bf44c00853ab72709e7d957/users/233963f89fde42f0b25f0391927c1c76/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:46.585568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.586485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.586769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:46.696617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:46.698801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.703443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] MFA Rules not processed for user `233963f89fde42f0b25f0391927c1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:46.704734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:46.708294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:46.952758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c510f7-80c0-4507-b121-1067c61f95ac admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:46.961502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:46.962149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:46.968012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:46.968375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:47.022498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 874/1733] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:47.030891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:47.034403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:47.116722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:47.118399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:47.130703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:47.155097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 860/1734] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:47.211868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1e5b-0fa5-4254-9315-43b3271fea16 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:47.223478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:47.224412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:47.224608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:47.228316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:47.236653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:47.370396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:47.371895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:47.392464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 875/1735] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:47.578282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:47.580302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:47.631856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf5bfb-dc8c-4aa2-aa51-2289075c32be service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:47.645606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:47.650618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:47.651077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:47.651384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] PATH_INFO: `/v3/projects/d3eaddd20c364d98b0605083bd013cad` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:47.657639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3eaddd20c364d98b0605083bd013cad)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:47.665871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:47.841153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3eaddd20c364d98b0605083bd013cad', 'request_id': 'req-e2fd0721-5346-4359-a4fb-527f740b5d8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:47.870673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3eaddd20c364d98b0605083bd013cad', 'request_id': 'req-e2fd0721-5346-4359-a4fb-527f740b5d8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:47.887399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3eaddd20c364d98b0605083bd013cad', 'request_id': 'req-e2fd0721-5346-4359-a4fb-527f740b5d8b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:47.921735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] The token cache is being invalidate because project d3eaddd20c364d98b0605083bd013cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:47.922030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:47.923404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:47.925867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 861/1736] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:47 2022] DELETE /identity/v3/projects/d3eaddd20c364d98b0605083bd013cad => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:47.931616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:47.953209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03a35-35d7-4ceb-aa60-866471d9a1f4 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:48.111944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:48.112621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:48.112896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:48.113167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] PATH_INFO: `/v3/users/98c697b066d7437ca35ce3da86df0e9a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:48.117730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c697b066d7437ca35ce3da86df0e9a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:48.121747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:48.237752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c697b066d7437ca35ce3da86df0e9a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:48.239831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c697b066d7437ca35ce3da86df0e9a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:48.240815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c697b066d7437ca35ce3da86df0e9a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:48.259836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c697b066d7437ca35ce3da86df0e9a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:48.273540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c697b066d7437ca35ce3da86df0e9a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:48.300406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:48.325098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 876/1737] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:47 2022] DELETE /identity/v3/users/98c697b066d7437ca35ce3da86df0e9a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:49.234629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:49.236169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:49.333159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:49.387482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0721-5346-4359-a4fb-527f740b5d8b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:49.479529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:49.480165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:49.480436 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:49.480852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:49.486712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:49.660269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:49.665538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39849467-b1af-4683-963b-b383ee8b92db service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:49.692097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:49.693818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:49.722342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 862/1738] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:49.772810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:49.773044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:49.773317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:49.898534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] MFA Rules not processed for user `1686820720f24e9aa3b63508b8514367`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:49.900093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:49.911622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2de8-ec23-4964-8584-b5734cd1b1a8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:49.932962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:49.947991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:49.948350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:49.948626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] PATH_INFO: `/v3/projects/dd0da5f8b4764f548985d1a2512ca003` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:49.952068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0da5f8b4764f548985d1a2512ca003)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:49.956332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:50.079061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 863/1739] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:50.080080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:50.082990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0da5f8b4764f548985d1a2512ca003', 'request_id': 'req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.100002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0da5f8b4764f548985d1a2512ca003', 'request_id': 'req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.100936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:50.127165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0da5f8b4764f548985d1a2512ca003', 'request_id': 'req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.150643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] The token cache is being invalidate because project dd0da5f8b4764f548985d1a2512ca003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:50.150935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.166085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7a1ce7cc-a149-4328-b8ef-8cfa8ab11939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.171473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 877/1740] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:49 2022] DELETE /identity/v3/projects/dd0da5f8b4764f548985d1a2512ca003 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:50.173051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202eaf3-a46a-479c-b89f-8523e1e90e13 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.173366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202eaf3-a46a-479c-b89f-8523e1e90e13 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.173668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202eaf3-a46a-479c-b89f-8523e1e90e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.194649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c85cf7-6ce8-49ea-bda3-e49f8e9ae964 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:50.245072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f202eaf3-a46a-479c-b89f-8523e1e90e13 None None] MFA Rules not processed for user `1686820720f24e9aa3b63508b8514367`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:50.246083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f202eaf3-a46a-479c-b89f-8523e1e90e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:50.318938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:50.392051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:50.392885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.393165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.393443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] PATH_INFO: `/v3/projects/2aaf25d6768545eeb9f17c6b7a584ab2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.396463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aaf25d6768545eeb9f17c6b7a584ab2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:50.404241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:50.485175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 878/1741] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:50.492836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c440a-3967-4c6a-b408-a8ca2d34677e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.493259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c440a-3967-4c6a-b408-a8ca2d34677e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.493534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c440a-3967-4c6a-b408-a8ca2d34677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.538650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aaf25d6768545eeb9f17c6b7a584ab2', 'request_id': 'req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.561625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aaf25d6768545eeb9f17c6b7a584ab2', 'request_id': 'req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.564199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c78c440a-3967-4c6a-b408-a8ca2d34677e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:50.565438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c78c440a-3967-4c6a-b408-a8ca2d34677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:50.588415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aaf25d6768545eeb9f17c6b7a584ab2', 'request_id': 'req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.626441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] The token cache is being invalidate because project 2aaf25d6768545eeb9f17c6b7a584ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:50.626789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.627941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6d5bd9da-3a94-45bb-acd5-cf7158f43dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:50.635631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 864/1742] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:50 2022] DELETE /identity/v3/projects/2aaf25d6768545eeb9f17c6b7a584ab2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:50.640243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.640532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.640799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.642352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 865/1743] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 13:13:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:50.644959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:50.655010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:50.677297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:50.810056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 879/1744] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:50.811478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56cc97-d026-4fab-84c1-b1c08298cd8f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.811931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56cc97-d026-4fab-84c1-b1c08298cd8f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.812488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56cc97-d026-4fab-84c1-b1c08298cd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.870357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19735-1fcd-459b-8f59-530e4dff2d03 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:50.875087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3d56cc97-d026-4fab-84c1-b1c08298cd8f None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:50.881927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d56cc97-d026-4fab-84c1-b1c08298cd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:50.888927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:50.889725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:50.890148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:50.890544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] PATH_INFO: `/v3/users/7f07b93f7f0d4b308e78e7464b2e7904` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:50.896823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f07b93f7f0d4b308e78e7464b2e7904)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:50.899292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.018824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f07b93f7f0d4b308e78e7464b2e7904'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:51.048372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f07b93f7f0d4b308e78e7464b2e7904'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:51.064378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f07b93f7f0d4b308e78e7464b2e7904'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:51.065596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f07b93f7f0d4b308e78e7464b2e7904'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:51.067049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:51.074173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 880/1745] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:51.091261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.091563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.091838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.091959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5a78c40b-905d-42d3-8fd8-b46a09fb2e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f07b93f7f0d4b308e78e7464b2e7904'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:51.100049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 866/1746] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:50 2022] DELETE /identity/v3/users/7f07b93f7f0d4b308e78e7464b2e7904 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:51.116236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.117600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.117870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.137022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] MFA Rules not processed for user `1684906668f04bc985e21078d9057371`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:51.138331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.168252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:51.172119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.310158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 881/1747] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:51.310158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.327274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 867/1748] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:51.332275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.355856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b585084-9f64-4e41-82a9-304ff7f6629e None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.369306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.370373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.370847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.371417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.372416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:51.372914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.377420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.408793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 868/1749] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:51.411407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.434332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7658a-ae8e-47c0-9e2a-d772eb50467e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.454350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.455523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.456001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.456536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.457378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.461515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3c38d-ae4a-4595-b428-7b384e05f96a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.529957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 869/1750] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:51 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:51.536080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07fc1d-944f-41d1-92c6-f5f8090a38ee None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.538439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07fc1d-944f-41d1-92c6-f5f8090a38ee None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.538906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07fc1d-944f-41d1-92c6-f5f8090a38ee None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.543565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e5cd-d768-4cf2-a551-d0c2381fcb83 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.545503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 870/1751] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 13:13:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:51.548016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07fc1d-944f-41d1-92c6-f5f8090a38ee None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.559841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:51.695345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07fc1d-944f-41d1-92c6-f5f8090a38ee None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.701723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.702549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.703019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.703621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.704455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.706823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab7a32-a99f-401a-a793-e5257c7b18d8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.711633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.712289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.712796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.713081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.717618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.752474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 871/1752] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:51 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:51.753705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.753997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.760973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.822172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:51.823819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.843915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 872/1753] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:51.850326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.878428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0822824-28a9-46fb-a715-cdf71fc14e49 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.885014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.885748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.886092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.886473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.887240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.889239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.900547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.902883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.907605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 873/1754] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:51.908813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.910961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.926458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef139-fc52-488d-a851-619399bae06a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:51.931623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:51.932472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:51.932756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:51.933173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] PATH_INFO: `/v3/projects/40f95cf921cb4f00a2d28c3fef171b50` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:51.934679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f95cf921cb4f00a2d28c3fef171b50)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:51.936648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:51.941495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 882/1755] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:51.943305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:51.948710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:51.954071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:52.022725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f95cf921cb4f00a2d28c3fef171b50', 'request_id': 'req-9fd724ad-024c-4924-90af-12c79d5868a8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:52.033511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f95cf921cb4f00a2d28c3fef171b50', 'request_id': 'req-9fd724ad-024c-4924-90af-12c79d5868a8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:52.042761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f95cf921cb4f00a2d28c3fef171b50', 'request_id': 'req-9fd724ad-024c-4924-90af-12c79d5868a8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:52.082416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] The token cache is being invalidate because project 40f95cf921cb4f00a2d28c3fef171b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:52.083136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:52.084022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:52.086647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 874/1756] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:51 2022] DELETE /identity/v3/projects/40f95cf921cb4f00a2d28c3fef171b50 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:52.090367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:52.098116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.149648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34050c9b-02a2-410b-9c23-89950fe939f8 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:52.267870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:52.293831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:52.294460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.294744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.295172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.298655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.312079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd724ad-024c-4924-90af-12c79d5868a8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:52.327460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:52.327460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.327460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.327460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.328253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:52.328253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62762ab3-3bfc-49de-b5b3-a8eb1297f685 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:52.343225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 875/1757] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:52.345603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.345722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.345944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.372077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:52.372411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.392074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 876/1758] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:52.392074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:52.410595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf6612-984d-4a26-a636-1c06d36f7177 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:52.426294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:52.427004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.427521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.427859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] PATH_INFO: `/v3/projects/63ac2122a8aa48aa8302d10f5b1e6c35/users/3b4b4524ef984caa8efbb34320fe4c69/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.479428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:52.481011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a70674-296a-4ed3-9d77-be553ab4bacc service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:52.491107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ac2122a8aa48aa8302d10f5b1e6c35, user_id=3b4b4524ef984caa8efbb34320fe4c69, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:52.495685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a6a4b-47b7-49ad-a379-a019f892cfe2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:52.510131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 883/1759] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:52.511907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af856b7-f359-4a7d-b189-8fd76d6b2fd6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.512205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af856b7-f359-4a7d-b189-8fd76d6b2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.512600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af856b7-f359-4a7d-b189-8fd76d6b2fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.526243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 877/1760] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:52 2022] PUT /identity/v3/projects/63ac2122a8aa48aa8302d10f5b1e6c35/users/3b4b4524ef984caa8efbb34320fe4c69/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:52.528665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc7-6e4b-4cee-9474-d937ad81092a None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.530911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc7-6e4b-4cee-9474-d937ad81092a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.531456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef2dc7-6e4b-4cee-9474-d937ad81092a None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.537131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 878/1761] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 13:13:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:52.538698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0dc9d-5a06-45bd-8f1f-a3e80e8a88a6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.539216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0dc9d-5a06-45bd-8f1f-a3e80e8a88a6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.540541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0dc9d-5a06-45bd-8f1f-a3e80e8a88a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.566600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0af856b7-f359-4a7d-b189-8fd76d6b2fd6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:52.571606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0af856b7-f359-4a7d-b189-8fd76d6b2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.624569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-feb0dc9d-5a06-45bd-8f1f-a3e80e8a88a6 None None] MFA Rules not processed for user `3b4b4524ef984caa8efbb34320fe4c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:52.625826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-feb0dc9d-5a06-45bd-8f1f-a3e80e8a88a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.734590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 884/1762] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:52.734590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.734590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.736823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.775818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:52.790366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:52.792045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.800488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 879/1763] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:52.802018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.802556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.802985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.888959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] MFA Rules not processed for user `72f072c5cd5d43538aa0106eee042559`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:52.893520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:52.898840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 885/1764] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:52.899862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:52.952201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02343-e32d-4896-ba6c-400e29965431 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:52.982440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:52.983857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:52.986266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:52.986556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:52.987286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:13:52.987601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:52.996643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.026635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:53.033542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 886/1765] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:13:53.034514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.056570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bba074-f5f2-4638-ac07-4d9ed5325103 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.076585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.081004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.082748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.084054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.096496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.096496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.120488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 880/1766] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:53.120488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.120488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:53.162649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 887/1767] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:53.164150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.226155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af342a19-3af1-486f-8ca2-17e17f220172 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.296550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0c1b-58c3-4730-8fc8-175c58b355ce admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.303740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.304648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.304928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.305195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.305859 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.308632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f59a7-10e6-486a-ad85-f2d6b1026f9c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.340707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.342050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.342531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.342941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.384113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 888/1768] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:53.385878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.386174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.386448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.461107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] MFA Rules not processed for user `bc188fdd8d7d4697a1203661b7facf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:53.463381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:53.476107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:53.515816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.524510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c26791-854e-4fb4-b3c9-1656cbd17cd9 service glance] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.544510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 881/1769] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:53.546270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.547327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.549746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.618393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] MFA Rules not processed for user `72f072c5cd5d43538aa0106eee042559`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:53.619895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:53.661916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 889/1770] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:53.661916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.703324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 882/1771] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:53.704307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.813229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ebcd-37de-4408-b75c-a7746711fcab None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.818388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.819168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:53.819482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.819769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.820033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.820819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.823408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.842998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be10377-0e3e-4918-98fe-350dd671c9d8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.857262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 883/1772] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:53.858648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.859651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.861664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.862112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.862526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.863342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.870340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.873400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94731-8eec-4aa2-899c-07bb97e5d1f0 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.878695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.879570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.879933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.880269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.881041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.882929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.903270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 884/1773] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:53.906718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.922657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 890/1774] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:53.924849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ed41b-3fd2-4cae-95da-74a0fd1b4687 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.929610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.936496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.938555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.939285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.939915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.941422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.945736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8395a-aa4e-458b-836e-87ea1a23bfe2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.948782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d980d08-4772-47ea-90d8-7378d707ca3d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:53.953949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:53.955379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.955898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.956382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.957281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:53.959327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004df5f-6559-4a3a-9c0a-795a3721baeb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:53.975711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 885/1775] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:53.977114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593383-d684-42e4-9492-9b4a264b9499 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.977395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593383-d684-42e4-9492-9b4a264b9499 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.977669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593383-d684-42e4-9492-9b4a264b9499 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:53.984435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 886/1776] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 13:13:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:53.985374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593383-d684-42e4-9492-9b4a264b9499 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:53.989558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 891/1777] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:13:53.991207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cef-a024-45ce-9bc5-ccc2aa8b18a4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:53.992006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cef-a024-45ce-9bc5-ccc2aa8b18a4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:53.992728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cef-a024-45ce-9bc5-ccc2aa8b18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.032693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593383-d684-42e4-9492-9b4a264b9499 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.057198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.057908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.058209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.058461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] PATH_INFO: `/v3/projects/2ea61b4f9f314ead9b4e5f51577fb5db/users/890b86a49d124768b030e9e713edd8b6/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.059442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-efa42cef-a024-45ce-9bc5-ccc2aa8b18a4 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:54.061781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-efa42cef-a024-45ce-9bc5-ccc2aa8b18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.112002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea61b4f9f314ead9b4e5f51577fb5db, user_id=890b86a49d124768b030e9e713edd8b6, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.117083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.154228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 887/1778] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:53 2022] PUT /identity/v3/projects/2ea61b4f9f314ead9b4e5f51577fb5db/users/890b86a49d124768b030e9e713edd8b6/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:54.154228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.189788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 892/1779] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:54.191590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c28e7-1bae-48cb-96c9-171950ec124c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.191933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c28e7-1bae-48cb-96c9-171950ec124c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.192206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c28e7-1bae-48cb-96c9-171950ec124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.261358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:54.278828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3d1c28e7-1bae-48cb-96c9-171950ec124c None None] MFA Rules not processed for user `890b86a49d124768b030e9e713edd8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:54.283968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d1c28e7-1bae-48cb-96c9-171950ec124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.343934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e5389-13d5-4d55-a018-fa33e205a365 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.357936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.358556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.360960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.362518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] PATH_INFO: `/v3/projects/2d93f8b9030f4447a106a7a03cb20009/users/52d18bc2170342359271c5c08184a9ff/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.387789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d93f8b9030f4447a106a7a03cb20009, user_id=52d18bc2170342359271c5c08184a9ff, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.393472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.419522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 888/1780] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:54 2022] PUT /identity/v3/projects/2d93f8b9030f4447a106a7a03cb20009/users/52d18bc2170342359271c5c08184a9ff/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:54.420607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.428599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.445062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 893/1781] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:54.447362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569480-1461-4bda-9029-9be403487078 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.447710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569480-1461-4bda-9029-9be403487078 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.447992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569480-1461-4bda-9029-9be403487078 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.449853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 894/1782] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 13:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:13:54.451209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569480-1461-4bda-9029-9be403487078 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.537207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac4328-71d1-48dd-a168-c05010004db9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.548994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.550631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.551510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.552271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.563901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.564123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:54.565853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.573564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569480-1461-4bda-9029-9be403487078 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.579909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 889/1783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:54.581019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.582445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.583344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.583726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.584093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.584917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.594242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dbe1b-b09a-440e-a220-08d5523a8836 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.595587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ee65f-2fd7-471d-b6f4-5005c6286f2c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.600157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.600948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.601437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.601885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.602760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.604900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.609407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 895/1784] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:54.611414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.612520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.615818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.644882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:54.646408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.654896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 896/1785] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:13:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:54.655885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.657295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.657880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 890/1786] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:13:54 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:54.659072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.674920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf282c-b167-4a43-a8be-d540221534b3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.782561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.783560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.784892 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.785246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] PATH_INFO: `/v3/users/a728632144354b7395f7bd7fb27b31f9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.787625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a728632144354b7395f7bd7fb27b31f9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.793909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.809215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd59c-e5c7-4d80-beaf-66a6892d2c38 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.814636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.815531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.815961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.816238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] PATH_INFO: `/v3/projects/2d93f8b9030f4447a106a7a03cb20009/users/52d18bc2170342359271c5c08184a9ff/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.818683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d93f8b9030f4447a106a7a03cb20009, user_id=52d18bc2170342359271c5c08184a9ff, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.821992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.839131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 891/1787] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:54 2022] PUT /identity/v3/projects/2d93f8b9030f4447a106a7a03cb20009/users/52d18bc2170342359271c5c08184a9ff/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:54.840085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.881314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:54.898404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a728632144354b7395f7bd7fb27b31f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:54.900033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a728632144354b7395f7bd7fb27b31f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:54.903103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a728632144354b7395f7bd7fb27b31f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:54.921647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a728632144354b7395f7bd7fb27b31f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:54.933205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a728632144354b7395f7bd7fb27b31f9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:54.935955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0c837-7f3e-43fd-b4d6-c122b5410b40 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:54.943642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:54.945045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:54.946074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:54.946896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:54.947736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:54.950118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:54.964266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 897/1788] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:54 2022] DELETE /identity/v3/users/a728632144354b7395f7bd7fb27b31f9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:54.965131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.969970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:54.988287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 892/1789] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:13:54 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:13:54.991474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:54.992215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.015595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12d44-f143-423f-9e5e-92e31a84c1f4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.100129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68bb4a-1b2d-46a2-9cc7-68b19785be2c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.105069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.105966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.107061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.107378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] PATH_INFO: `/v3/users/82fa4b8525af43628ca75d9fd46ed6b8` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.108812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fa4b8525af43628ca75d9fd46ed6b8)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.110690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.111060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.111851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.112332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.112793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.115428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.133412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.135170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7544-1ee2-4cbc-b541-2c5d597f6d82 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.156063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 898/1790] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:55.157425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.157883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.158297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.188154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:55.229956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] MFA Rules not processed for user `52d18bc2170342359271c5c08184a9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:55.234418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.239286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fa4b8525af43628ca75d9fd46ed6b8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:55.266909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fa4b8525af43628ca75d9fd46ed6b8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:55.282097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fa4b8525af43628ca75d9fd46ed6b8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:55.283793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fa4b8525af43628ca75d9fd46ed6b8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:55.312807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1a343d5b-d1da-45cf-9f75-bd05dff5d149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fa4b8525af43628ca75d9fd46ed6b8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:55.322785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 893/1791] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:54 2022] DELETE /identity/v3/users/82fa4b8525af43628ca75d9fd46ed6b8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:55.326706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.326706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.326706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.349893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:55.352286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.381860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 899/1792] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:55.381860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.382769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.427230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93458c9-8c80-4663-80b6-5b2cf54f4c08 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.428433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:55.490501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 894/1793] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:55.494545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.496150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.544970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.545759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.546287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.546727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.547569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.549936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.563537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 900/1794] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:55.564576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.566573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.619693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539e14a-28b9-4610-a5f4-b2131561d87d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.631393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.632150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.632439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.632886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.634910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.684374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77766e-8e82-4845-99dc-6bc1961ea842 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.693177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.694166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.698865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.699765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.704092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.722812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.725203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fbfeb-e418-4828-b689-0ccab2a299d3 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.747824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 901/1795] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:55.749613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.750146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.750696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.775756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:55.777246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.786041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 902/1796] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:55.787558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.793111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.794762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.798974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.818986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 895/1797] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:55.820212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.821839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:55.832125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:55.902890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39dcb-f8ff-4cc5-9fb9-e4773a4a0441 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.910188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.911171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.911509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.911795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:55.937031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:55.940022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:55.981200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0b903-fe48-45dc-b606-818f8ebb94a9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:55.985073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 896/1798] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:55.985210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:55.998339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:55.998981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:55.999280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:55.999552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.032869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884bdc-3a2a-4693-8137-74cd35f6c518 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.063222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:56.063967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.064247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.064519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] PATH_INFO: `/v3/projects/d03d90af9de94bbcb80db342cd5673a2/users/b9927076a97b4574872d0ea563184666/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.122226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.124162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.129700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03d90af9de94bbcb80db342cd5673a2, user_id=b9927076a97b4574872d0ea563184666, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.132968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.137998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 903/1799] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:56.139394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:56.141456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:56.151810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:56.156297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abbb7-3f7a-4165-b20d-244c82e0b8fa service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.164530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:56.165234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.165512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.165784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.188411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.193930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 897/1800] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:55 2022] PUT /identity/v3/projects/d03d90af9de94bbcb80db342cd5673a2/users/b9927076a97b4574872d0ea563184666/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:56.194095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.194184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:56.197974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:56.213950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 904/1801] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:56.216060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:56.237605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806589f-efc7-4ce0-9da4-2458ea31c658 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.451549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:56.453362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.455082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.455516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.457332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.463256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.464750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221d108-27da-49e1-9199-815def19bf4a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.489618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 905/1802] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:13:56.491899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:56.492534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:56.494223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.495316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.495903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.502250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:56.515737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901e72-c0ee-4b93-94e0-af5c2f24fd40 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.526557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:56.528893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.529858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.530247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] PATH_INFO: `/v3/projects/d03d90af9de94bbcb80db342cd5673a2/users/b9927076a97b4574872d0ea563184666/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.535840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03d90af9de94bbcb80db342cd5673a2, user_id=b9927076a97b4574872d0ea563184666, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.546001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfbaac-ff3e-49e1-ae96-e37def8febe2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.578732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 906/1803] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:13:56 2022] PUT /identity/v3/projects/d03d90af9de94bbcb80db342cd5673a2/users/b9927076a97b4574872d0ea563184666/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:56.590568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:56.590568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:56.590568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:56.663831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] MFA Rules not processed for user `b9927076a97b4574872d0ea563184666`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:56.665438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:56.698766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:56.701924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:56.728780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:56.736751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 898/1804] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:56.739586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:56.743060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:56.822595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3145a2-53e7-49f0-9959-adba447cfe03 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:56.952118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 907/1805] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:56.966183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:57.065289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:57.066008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:57.066287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:57.066761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] PATH_INFO: `/v3/projects/a75c599f43c947be9ae0fdc408ac4009` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:57.072105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75c599f43c947be9ae0fdc408ac4009)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:57.084936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:57.189782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:57.199890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d96d8-88df-4e9d-ba10-1467641186d9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:57.254703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75c599f43c947be9ae0fdc408ac4009', 'request_id': 'req-96e40baa-8939-423a-bee3-481cd660e4f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.277259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75c599f43c947be9ae0fdc408ac4009', 'request_id': 'req-96e40baa-8939-423a-bee3-481cd660e4f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.296471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75c599f43c947be9ae0fdc408ac4009', 'request_id': 'req-96e40baa-8939-423a-bee3-481cd660e4f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.352118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] The token cache is being invalidate because project a75c599f43c947be9ae0fdc408ac4009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:57.352410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.359683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.367078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 899/1806] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:56 2022] DELETE /identity/v3/projects/a75c599f43c947be9ae0fdc408ac4009 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:57.369529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:57.377293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:57.380582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:57.381512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:57.383219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:57.386219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:57.390119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:57.648561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40baa-8939-423a-bee3-481cd660e4f8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:57.657661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:57.669680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:57.670390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:57.670737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:57.671632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] PATH_INFO: `/v3/projects/384ff7fec8c94b0894ac1057d6621bfe` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:57.675576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384ff7fec8c94b0894ac1057d6621bfe)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:57.682221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:57.686706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:57.728955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 908/1807] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:13:57.730080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:57.734079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:57.771360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae341c-e343-4f10-949f-94ecfd346ef7 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:57.783339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:57.786463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:57.786761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:57.787050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] PATH_INFO: `/v3/users/e8566431803146f485b1b90b46e99319` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:57.792042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8566431803146f485b1b90b46e99319)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:57.794454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:57.864949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:57.911567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384ff7fec8c94b0894ac1057d6621bfe', 'request_id': 'req-53fa855e-e9c6-41ff-9e72-f2852864eea3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.929019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384ff7fec8c94b0894ac1057d6621bfe', 'request_id': 'req-53fa855e-e9c6-41ff-9e72-f2852864eea3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.943246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384ff7fec8c94b0894ac1057d6621bfe', 'request_id': 'req-53fa855e-e9c6-41ff-9e72-f2852864eea3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:57.997384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] The token cache is being invalidate because project 384ff7fec8c94b0894ac1057d6621bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:57.997674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.005314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.010520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8566431803146f485b1b90b46e99319'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.017789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 900/1808] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:57 2022] DELETE /identity/v3/projects/384ff7fec8c94b0894ac1057d6621bfe => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:58.020475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:58.024107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:58.024814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8566431803146f485b1b90b46e99319'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.030598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8566431803146f485b1b90b46e99319'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.059243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8566431803146f485b1b90b46e99319'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.092136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8566431803146f485b1b90b46e99319'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.148085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 909/1809] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:57 2022] DELETE /identity/v3/users/e8566431803146f485b1b90b46e99319 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:58.151612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:58.156408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:58.231432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:58.276988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa855e-e9c6-41ff-9e72-f2852864eea3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:58.371678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023f6f-6338-4f30-89b4-92bc15e03de5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:58.397959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:58.398629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:58.398920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:58.399173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] PATH_INFO: `/v3/users/233963f89fde42f0b25f0391927c1c76` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:58.404960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=233963f89fde42f0b25f0391927c1c76)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:58.407559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:58.487823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:58.488894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:58.489315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:58.489837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] PATH_INFO: `/v3/users/890b86a49d124768b030e9e713edd8b6` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:58.491841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890b86a49d124768b030e9e713edd8b6)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:58.499074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:58.579940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233963f89fde42f0b25f0391927c1c76'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.581512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233963f89fde42f0b25f0391927c1c76'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.583822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233963f89fde42f0b25f0391927c1c76'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.605174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233963f89fde42f0b25f0391927c1c76'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.620125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-7d4fcf11-77f4-406d-af16-1ab4d82e3f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233963f89fde42f0b25f0391927c1c76'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.661398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 910/1810] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:58 2022] DELETE /identity/v3/users/233963f89fde42f0b25f0391927c1c76 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:58.701808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890b86a49d124768b030e9e713edd8b6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.725165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:58.725455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:58.725737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:58.733001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890b86a49d124768b030e9e713edd8b6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.760994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890b86a49d124768b030e9e713edd8b6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.762631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890b86a49d124768b030e9e713edd8b6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.764378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] MFA Rules not processed for user `72f072c5cd5d43538aa0106eee042559`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:58.766166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:58.783929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:58.826508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b97d2059-f049-4f03-b7fc-7793c18cdf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890b86a49d124768b030e9e713edd8b6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:58.847654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 901/1811] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:58 2022] DELETE /identity/v3/users/890b86a49d124768b030e9e713edd8b6 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:13:58.853692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:58.861340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:58.861917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:58.915596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:58.918602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:58.938916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 911/1812] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:59.090692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 902/1813] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:59.161778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:59.163385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:59.311905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6644c6-bb92-4c0c-b417-caa5e8aa1e90 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:59.397838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:59.398453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:59.398855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:59.398989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:59.443685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:59.445178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671f15a-0e51-4d65-b43c-f0ea3a272039 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:59.449705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:59.451242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:59.468417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8f38-a4f9-43c2-a701-f8d87f601de4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:13:59.485226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 912/1814] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:13:59.485945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:13:59.486788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:59.487241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:59.487650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] PATH_INFO: `/v3/projects/dab593f4b5fb43f49e62a301a6a42242` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:59.491932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab593f4b5fb43f49e62a301a6a42242)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:13:59.494169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:13:59.529348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:13:59.661389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab593f4b5fb43f49e62a301a6a42242', 'request_id': 'req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:59.685906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab593f4b5fb43f49e62a301a6a42242', 'request_id': 'req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:59.703252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab593f4b5fb43f49e62a301a6a42242', 'request_id': 'req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:59.757088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] The token cache is being invalidate because project dab593f4b5fb43f49e62a301a6a42242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:13:59.757472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:59.758204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:13:59.759889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 903/1815] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:13:59 2022] DELETE /identity/v3/projects/dab593f4b5fb43f49e62a301a6a42242 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:13:59.764890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13dff-798e-4d16-9fe9-21f7e25cb659 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:59.765494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13dff-798e-4d16-9fe9-21f7e25cb659 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:59.766000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13dff-798e-4d16-9fe9-21f7e25cb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:59.812307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3ac13dff-798e-4d16-9fe9-21f7e25cb659 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:59.814484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3ac13dff-798e-4d16-9fe9-21f7e25cb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:59.872387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:59.874443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:59.933533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 913/1816] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:13:59.943358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949053cf-f23d-4294-b50d-4668da68843e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:13:59.943947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949053cf-f23d-4294-b50d-4668da68843e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:13:59.944390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949053cf-f23d-4294-b50d-4668da68843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:13:59.968371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-949053cf-f23d-4294-b50d-4668da68843e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:13:59.970221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-949053cf-f23d-4294-b50d-4668da68843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:13:59.979854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 914/1817] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:13:59.985830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949053cf-f23d-4294-b50d-4668da68843e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:13:59.996520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949053cf-f23d-4294-b50d-4668da68843e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.007517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.008486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.009296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.009743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.010588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:00.011082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.013632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.026021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:00.030621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 915/1818] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:00.035047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.041481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe8c3-5d7a-4bd1-a24c-91ccd39ba4d9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.058813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.060875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.061167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27665f9c-83cf-46f0-a952-0c6233e69b7d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.061267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.061450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] PATH_INFO: `/v3/users/3b4b4524ef984caa8efbb34320fe4c69` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.065274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4b4524ef984caa8efbb34320fe4c69)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.069725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.070992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.071795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.072145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.072504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.073217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.093072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.185578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 916/1819] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:00 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:00.192167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.227376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4b4524ef984caa8efbb34320fe4c69'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.243806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4b4524ef984caa8efbb34320fe4c69'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.260062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4b4524ef984caa8efbb34320fe4c69'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.261819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4b4524ef984caa8efbb34320fe4c69'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.299776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7e3e7078-b2c1-47b9-8a77-1c00b22051ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4b4524ef984caa8efbb34320fe4c69'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.319894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 904/1820] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:13:59 2022] DELETE /identity/v3/users/3b4b4524ef984caa8efbb34320fe4c69 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:00.323112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.323564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.323996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.362467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5447-24f9-43aa-a354-adb7703c42c7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.397672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:00.399123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:00.427558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:00.530715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.531479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.531824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.532248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.532991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.536483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.597564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 917/1821] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:00 2022] POST /identity/v3/users => generated 291 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:00.601120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 905/1822] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:00.602732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.604865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.611166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:00.616300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:00.651784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f18d6-a0a1-4dc2-a4e5-71b31ed04794 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.653337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22cb3b-b084-41dd-8b4b-97b7a9b1adf5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.666758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.670367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:00.672740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.673863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:00.674259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.674660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:00.674941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.675326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] PATH_INFO: `/v3/projects/406a9aad6bf44c00853ab72709e7d957` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:00.676789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.677619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=406a9aad6bf44c00853ab72709e7d957)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:00.681443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.682738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:00.705209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 906/1823] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:00.706519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.716625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:00.842749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406a9aad6bf44c00853ab72709e7d957', 'request_id': 'req-f905a657-6baf-4b82-9abf-211be1bd1e2d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.851919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce681-4471-49b3-a6ad-9780025f2f1a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:00.859051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406a9aad6bf44c00853ab72709e7d957', 'request_id': 'req-f905a657-6baf-4b82-9abf-211be1bd1e2d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.882007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406a9aad6bf44c00853ab72709e7d957', 'request_id': 'req-f905a657-6baf-4b82-9abf-211be1bd1e2d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.891438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:00.901558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] The token cache is being invalidate because project 406a9aad6bf44c00853ab72709e7d957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:00.902077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.903210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:00.910237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 918/1824] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:00 2022] DELETE /identity/v3/projects/406a9aad6bf44c00853ab72709e7d957 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:00.910237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:00.913114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.114867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.116163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.118176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.118689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.122203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.147666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905a657-6baf-4b82-9abf-211be1bd1e2d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.160603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.161252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.161784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.162067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.163027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.164759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc722fe5-b8cc-47a1-bc28-054d220c3c5a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.179512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.181149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.196158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 919/1825] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:01.197782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9518e-1280-4fdc-93c5-7bf97dac11be None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.198069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9518e-1280-4fdc-93c5-7bf97dac11be None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.198345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9518e-1280-4fdc-93c5-7bf97dac11be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.218375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 907/1826] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:01.219872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.243370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dc41-a1ac-49ed-b656-dba3331eb8c4 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.253055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.253323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d0c9518e-1280-4fdc-93c5-7bf97dac11be None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:01.254423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.254945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.255453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] PATH_INFO: `/v3/projects/2f5ed9cb38f544fcbd44c95dcd9b1b29/users/9dc57d6d120e413b92a13a25c7e9422d/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.261202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d0c9518e-1280-4fdc-93c5-7bf97dac11be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.279961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5ed9cb38f544fcbd44c95dcd9b1b29, user_id=9dc57d6d120e413b92a13a25c7e9422d, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.288453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49e32-c59c-46a2-a6f5-a8a84da0615f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.313330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 920/1827] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:01.319899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae28ec-5155-4848-ae86-47df9b0f1dcb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.320302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae28ec-5155-4848-ae86-47df9b0f1dcb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.320840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae28ec-5155-4848-ae86-47df9b0f1dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.348439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 908/1828] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:01 2022] PUT /identity/v3/projects/2f5ed9cb38f544fcbd44c95dcd9b1b29/users/9dc57d6d120e413b92a13a25c7e9422d/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:01.362966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.363277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.363541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.379875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7dae28ec-5155-4848-ae86-47df9b0f1dcb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:01.381109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7dae28ec-5155-4848-ae86-47df9b0f1dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.470252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] MFA Rules not processed for user `9dc57d6d120e413b92a13a25c7e9422d`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:01.471974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.566756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:01.587650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 921/1829] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:01.587650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.587650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.587650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.634339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 909/1830] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:01.635310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.653490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cd666-9384-444c-8d17-c1875ba88c18 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.660919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.662822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.663294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.663563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.664391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:01.664793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.666523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.680541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 910/1831] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:01.681466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.697218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feca859-bc20-4127-9d0b-95a444a8a5a7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.703522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.703635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:01.704342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.704678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.704779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:01.705019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.705778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.707951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.749209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 911/1832] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:01.750198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.838314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefa8a-39b4-4b3b-80bc-777e4a968661 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.843435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:01.845265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.846174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.846663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.846947 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.848769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.851447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.852018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 922/1833] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:01.853134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.887110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d57449-4488-41dd-81fc-b05791ba54a9 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:01.896376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 912/1834] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:01.901605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.902016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:01.902844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:01.903621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:01.904536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:01.905783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:01.908284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:01.943792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 923/1835] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:01.949018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:01.965871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82b379-3dc6-4392-87d1-2630ca5795d9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.000699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827b2b-a537-4b8e-be1c-80b9dd45ee3d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.012689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.013535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.014030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.014635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.015668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.018483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.052299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.055141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.055419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.055700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.057675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.060646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.061580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 913/1836] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:01 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:02.062534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.066444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.091296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 924/1837] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:02.094506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.099004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1c6c1-6283-44e9-b55b-2613069ef8f8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.100419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.113776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.114365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.114622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.114908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] PATH_INFO: `/v3/projects/2ea61b4f9f314ead9b4e5f51577fb5db` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.119405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea61b4f9f314ead9b4e5f51577fb5db)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.121306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.152566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:02.238635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea61b4f9f314ead9b4e5f51577fb5db', 'request_id': 'req-518e5406-3c94-4319-a05d-c5a458c7a0e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:02.245925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe7f8d-3f83-40f4-b7c3-b0a6ca4d4836 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.256321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea61b4f9f314ead9b4e5f51577fb5db', 'request_id': 'req-518e5406-3c94-4319-a05d-c5a458c7a0e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:02.298795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea61b4f9f314ead9b4e5f51577fb5db', 'request_id': 'req-518e5406-3c94-4319-a05d-c5a458c7a0e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:02.335682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:02.346248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] The token cache is being invalidate because project 2ea61b4f9f314ead9b4e5f51577fb5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:02.346768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:02.347772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.348330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:02.349529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.349823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.350108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.351263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 914/1838] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:02 2022] DELETE /identity/v3/projects/2ea61b4f9f314ead9b4e5f51577fb5db => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:02.352202 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.355968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.356534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.455602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.461537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.475090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 925/1839] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:14:02.476012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.478372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.543426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5406-3c94-4319-a05d-c5a458c7a0e6 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.566801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.567502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.567853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.568127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.568784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.570408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23757a3f-c6d5-4118-98d3-ad0d40f61479 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.598046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 915/1840] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:02.599438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.599722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.599992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.680936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] MFA Rules not processed for user `bc188fdd8d7d4697a1203661b7facf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:02.691575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.848599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39d69-463c-45c6-b5b4-75da8a60a0b2 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:02.855353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:02.856078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:02.856372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:02.856713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] PATH_INFO: `/v3/projects/0a19ebd1f1a0407c837b1145830e4f27/users/c04264981c8f4972a29ff9dc6f03fa92/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:02.878152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a19ebd1f1a0407c837b1145830e4f27, user_id=c04264981c8f4972a29ff9dc6f03fa92, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:02.881764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:02.917071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 926/1841] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:02 2022] PUT /identity/v3/projects/0a19ebd1f1a0407c837b1145830e4f27/users/c04264981c8f4972a29ff9dc6f03fa92/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:02.918054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.924142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 916/1842] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:02.927241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:02.939753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:02.988691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e0feb-ef3f-438a-800a-89ba311fc172 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.139855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:03.166459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bb1a1-95dd-4509-9860-5fd731a686b0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.187615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.187833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.188317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.188566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.188948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.189510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.189612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.190889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.192718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] PATH_INFO: `/v3/users/b9927076a97b4574872d0ea563184666` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.195719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.199756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9927076a97b4574872d0ea563184666)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.208210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.219216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 917/1843] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:03.220214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:03.249688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e87dd7-bd5b-40fd-b5e4-c06cd462dab8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.277570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.278238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.278514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.278749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.279548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.281188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.287544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:03.311840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 918/1844] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:03.312905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:03.360316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9927076a97b4574872d0ea563184666'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.362791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9927076a97b4574872d0ea563184666'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.372102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9927076a97b4574872d0ea563184666'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.382071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765152f-357e-48ff-8cc8-bee7ece5f703 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.401210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.407504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9927076a97b4574872d0ea563184666'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.410172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.412041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.413127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] PATH_INFO: `/v3/projects/19f52774f84a45959c9d9c15b3483ea2/users/5a0d3da7b95b4f0bb9f15c3e932287b8/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.429943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9927076a97b4574872d0ea563184666'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.468156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f52774f84a45959c9d9c15b3483ea2, user_id=5a0d3da7b95b4f0bb9f15c3e932287b8, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.476849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.510507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 927/1845] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:02 2022] DELETE /identity/v3/users/b9927076a97b4574872d0ea563184666 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:03.512527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:03.516221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:03.524027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 919/1846] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:03 2022] PUT /identity/v3/projects/19f52774f84a45959c9d9c15b3483ea2/users/5a0d3da7b95b4f0bb9f15c3e932287b8/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:03.535293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:03.544157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:03.714975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c3daf-1e31-4ac3-bfab-2315179283a5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.716940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec038d-ce48-49b5-81b9-abf5509d7f0e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:03.726676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.727785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:03.728529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.729284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.729651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.729991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] PATH_INFO: `/v3/projects/63ac2122a8aa48aa8302d10f5b1e6c35` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.730367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.731147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] PATH_INFO: `/v3/projects/0a19ebd1f1a0407c837b1145830e4f27/users/c04264981c8f4972a29ff9dc6f03fa92/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.732178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ac2122a8aa48aa8302d10f5b1e6c35)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.736570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a19ebd1f1a0407c837b1145830e4f27, user_id=c04264981c8f4972a29ff9dc6f03fa92, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:03.738209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.741578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257446a-dd55-4dde-b666-844c560fc46b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:03.783756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 928/1847] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:03 2022] PUT /identity/v3/projects/0a19ebd1f1a0407c837b1145830e4f27/users/c04264981c8f4972a29ff9dc6f03fa92/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:03.783756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.783756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.783756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:03.850552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] MFA Rules not processed for user `5a0d3da7b95b4f0bb9f15c3e932287b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:03.854212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ac2122a8aa48aa8302d10f5b1e6c35', 'request_id': 'req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.854623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:03.869735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ac2122a8aa48aa8302d10f5b1e6c35', 'request_id': 'req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.885202 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ac2122a8aa48aa8302d10f5b1e6c35', 'request_id': 'req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.915048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] The token cache is being invalidate because project 63ac2122a8aa48aa8302d10f5b1e6c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:03.915494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.916377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-dc6c939f-2ca9-46cf-9a74-dedeadbb78e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:03.919799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 920/1848] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:03 2022] DELETE /identity/v3/projects/63ac2122a8aa48aa8302d10f5b1e6c35 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:03.924509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:03.925169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:03.929722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.060790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] MFA Rules not processed for user `c04264981c8f4972a29ff9dc6f03fa92`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:04.064900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.110545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 929/1849] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:04.123735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.128864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.151283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:04.218014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:04.282112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 921/1850] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:04.282112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.285605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.305390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fed7a-cc3d-4748-911b-0d5f817057ff None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.314433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.315097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.315400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.315673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] PATH_INFO: `/v3/users/52d18bc2170342359271c5c08184a9ff` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.320268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b8db-373a-4c68-97bd-dc60cdccf625 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.321021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d18bc2170342359271c5c08184a9ff)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.323031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:04.332850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.333689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.333927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.334617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.335003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.337001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:04.398734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 922/1851] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:04 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:04.399834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.402018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.428558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d18bc2170342359271c5c08184a9ff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:04.431701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d18bc2170342359271c5c08184a9ff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:04.432813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d18bc2170342359271c5c08184a9ff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:04.451960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d18bc2170342359271c5c08184a9ff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:04.468869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d18bc2170342359271c5c08184a9ff'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:04.532823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 930/1852] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:04 2022] DELETE /identity/v3/users/52d18bc2170342359271c5c08184a9ff => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:04.542571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.546217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.600449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58031c74-7ea0-46be-88d0-350aafdf1439 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.681013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee1d4a-72a1-47c7-b99b-a6dff645da14 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.694922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.695578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.695924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.696197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.696951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.703827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:04.717756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.718640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.719845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.720292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.722710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:04.783469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 931/1853] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:04 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:04.784505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.816963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff420a-fc58-4dd0-8a3f-5c7d307c1a6a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.846277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.847103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.847471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.847832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.849102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.851127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:04.906776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 932/1854] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:04.910976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:04.914398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.917124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:04.932197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67860-c71e-4ab7-8afb-41efc45e9de5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:04.938557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:04.948895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:04.949806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:04.949923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:04.950133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] PATH_INFO: `/v3/projects/b604bde9115440adaec078523f7dd537/users/bb5cbd2525ef4eee8af876341377f384/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:04.975094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 923/1855] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:04.985769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b604bde9115440adaec078523f7dd537, user_id=bb5cbd2525ef4eee8af876341377f384, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:04.989038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:05.040048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 933/1856] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:04 2022] PUT /identity/v3/projects/b604bde9115440adaec078523f7dd537/users/bb5cbd2525ef4eee8af876341377f384/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:05.053798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:05.076931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727009-5987-4dd8-abfa-0febc96e7075 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:05.291718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:05.293045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:05.294174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:05.294901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:05.297030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:05.299668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:05.324862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 924/1857] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:05.325263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:05.331767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:05.365667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003bda3-f64d-4356-ad34-4a1133047493 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:05.374678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:05.375694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:05.376119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:05.376581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] PATH_INFO: `/v3/projects/b604bde9115440adaec078523f7dd537/users/bb5cbd2525ef4eee8af876341377f384/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:05.379270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b604bde9115440adaec078523f7dd537, user_id=bb5cbd2525ef4eee8af876341377f384, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:05.389409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc31c7-6013-4e10-b825-8f1d7663033e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:05.399882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:05.402315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:05.417055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 934/1858] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:05 2022] PUT /identity/v3/projects/b604bde9115440adaec078523f7dd537/users/bb5cbd2525ef4eee8af876341377f384/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:05.420539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:05.421233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:05.421481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:05.454009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403889b1-f4e0-4868-9ae4-5d48937fe3b3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:05.486826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] MFA Rules not processed for user `bb5cbd2525ef4eee8af876341377f384`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:05.488368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:05.646478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 935/1859] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:05.660919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:05.662479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:05.704068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:05.705312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:05.705754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:05.706348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] PATH_INFO: `/v3/projects/d03d90af9de94bbcb80db342cd5673a2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:05.708431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03d90af9de94bbcb80db342cd5673a2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:05.710635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:05.854213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd97187-7291-4f2b-bfed-5366d7371139 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:05.864073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03d90af9de94bbcb80db342cd5673a2', 'request_id': 'req-70392886-962e-4ef4-9405-50d9b6740f10'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:05.906664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03d90af9de94bbcb80db342cd5673a2', 'request_id': 'req-70392886-962e-4ef4-9405-50d9b6740f10'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:05.931164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03d90af9de94bbcb80db342cd5673a2', 'request_id': 'req-70392886-962e-4ef4-9405-50d9b6740f10'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:05.963830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] The token cache is being invalidate because project d03d90af9de94bbcb80db342cd5673a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:05.971568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:05.973522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:05.984944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 925/1860] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:05 2022] DELETE /identity/v3/projects/d03d90af9de94bbcb80db342cd5673a2 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:05.986642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:05.989981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:06.004298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:06.005708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.005708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.005708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.008832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:06.060884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:06.190051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:06.202267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392886-962e-4ef4-9405-50d9b6740f10 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:06.217003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c04264981c8f4972a29ff9dc6f03fa92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a19ebd1f1a0407c837b1145830e4f27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:06.217565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.217869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.218144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.219457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:06.219823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:06.221877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b74a7-5c18-4041-9e60-e498ca8d7efb tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:06.283437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 926/1861] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:06.287135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.287640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.288067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.302829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:06.304658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:06.320756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:06.322067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:06.337920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 936/1862] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:06.339506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:06.341620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:06.522663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 927/1863] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:06.526623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:06.552861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9055a0-56b1-4d40-8864-c0f23a88744a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:06.553084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090516c-7c3c-4a53-8926-76399d9decd2 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:06.569088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:06.570844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.571670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.574205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] PATH_INFO: `/v3/projects/2d93f8b9030f4447a106a7a03cb20009` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.576341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d93f8b9030f4447a106a7a03cb20009)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:06.581126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:06.585298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c04264981c8f4972a29ff9dc6f03fa92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a19ebd1f1a0407c837b1145830e4f27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:06.590927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.591524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.596200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.613442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:06.623214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcb55e-6252-427f-8128-ddbad58e9941 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:06.764290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 928/1864] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:06 2022] POST /identity/v3/projects => generated 354 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:06.765116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d93f8b9030f4447a106a7a03cb20009', 'request_id': 'req-e10f4068-d600-49da-80cd-3f2fe5dca3b4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:06.766572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.766895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.767167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.787216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d93f8b9030f4447a106a7a03cb20009', 'request_id': 'req-e10f4068-d600-49da-80cd-3f2fe5dca3b4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:06.808519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d93f8b9030f4447a106a7a03cb20009', 'request_id': 'req-e10f4068-d600-49da-80cd-3f2fe5dca3b4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:06.827978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] The token cache is being invalidate because project 2d93f8b9030f4447a106a7a03cb20009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:06.828656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:06.829708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e10f4068-d600-49da-80cd-3f2fe5dca3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:06.831543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 937/1865] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:06 2022] DELETE /identity/v3/projects/2d93f8b9030f4447a106a7a03cb20009 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:06.836669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06ea4-a4a1-42b4-a8f3-db57f4984b5a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:06.838853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06ea4-a4a1-42b4-a8f3-db57f4984b5a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:06.839155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe06ea4-a4a1-42b4-a8f3-db57f4984b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:06.847145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:06.855753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:06.885763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-bbe06ea4-a4a1-42b4-a8f3-db57f4984b5a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:06.886836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bbe06ea4-a4a1-42b4-a8f3-db57f4984b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:07.046693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 929/1866] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:07.054512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.058971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:07.186396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 938/1867] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:07.188374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.188783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.189128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.232414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:07.241972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:07.243232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:07.263379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d1bf0-4ac3-4693-80bd-bf840dc68067 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.267439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 939/1868] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:07.268327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.276382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:07.282191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c04264981c8f4972a29ff9dc6f03fa92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a19ebd1f1a0407c837b1145830e4f27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.282908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.283295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.283668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.284403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:07.284795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.290266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22221c-ed31-48c0-8fad-be5c1eeca5bc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.290964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.305912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.306333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.306613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.306884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.307739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:07.308040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.311455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.322228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 930/1869] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:07.323225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.330170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:07.338153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 940/1870] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:07.339077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.354250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfde79c-9432-4629-9755-5311bc0ec4d4 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.363862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37edbd-e713-48d1-9050-d987640cccb1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.367410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.368055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.368361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.368591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.377037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.377668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.377965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.378210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.386777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.388290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ab545-0a23-4834-a5ba-44d945395677 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.396425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.397846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.408242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 931/1871] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:07.409665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.419209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.419642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.422682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 941/1872] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:07.423571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.452210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c761b-cedb-4b47-8a19-11d9f4ad6a42 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.464656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:07.465966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:07.475173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.475831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.476108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.476548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.477189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.479155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.511552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 932/1873] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:07.511552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.548589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e673d7-eb2c-4621-864a-64e0632b1b5f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.556464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c04264981c8f4972a29ff9dc6f03fa92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a19ebd1f1a0407c837b1145830e4f27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:07.557182 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:07.557489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:07.557814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] PATH_INFO: `/v3/projects/36c6a69dc3fa4f48afc8ec8fa72e4060` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:07.569360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36c6a69dc3fa4f48afc8ec8fa72e4060)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:07.574078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 942/1874] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:07 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:07.575039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:07.579490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:07.807221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf30ce-f416-4f61-b525-467008b02c9a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:07.867117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c6a69dc3fa4f48afc8ec8fa72e4060', 'request_id': 'req-b4675787-3bc5-4a02-986f-dd847096c940'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:07.895033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c6a69dc3fa4f48afc8ec8fa72e4060', 'request_id': 'req-b4675787-3bc5-4a02-986f-dd847096c940'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:07.929023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c6a69dc3fa4f48afc8ec8fa72e4060', 'request_id': 'req-b4675787-3bc5-4a02-986f-dd847096c940'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:07.973452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] The token cache is being invalidate because project 36c6a69dc3fa4f48afc8ec8fa72e4060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:07.973779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:07.975817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:07.985732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 933/1875] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:07 2022] DELETE /identity/v3/projects/36c6a69dc3fa4f48afc8ec8fa72e4060 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:07.986661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.003779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.004611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.004731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.005203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.005881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:08.006190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.008123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.021307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.026995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 943/1876] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:08.028257 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.030949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.054098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4efe92-fba5-4b6b-ba9c-65dab0e06044 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.061606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.062296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.062774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.063051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.063809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.070743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.117695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4675787-3bc5-4a02-986f-dd847096c940 tempest-VolumeQuotaClassesTest-131464840 tempest-VolumeQuotaClassesTest-131464840-project-admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.144019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.144707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.147133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.147466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.150535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.151003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 944/1877] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:08 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:08.157088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.157845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.159765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.228122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 934/1878] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:07 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:08.230344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.247476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:08.257685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b41a-1081-4847-805f-eaa84dc0fdb9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.307756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a55f-ebef-4af8-a1de-0f1e59fad4b8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.314096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.315283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.315593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.315850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] PATH_INFO: `/v3/users/5a0d3da7b95b4f0bb9f15c3e932287b8` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.317179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d3da7b95b4f0bb9f15c3e932287b8)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.319867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.399045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.399928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.400532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.400803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.401430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.408536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.434485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d3da7b95b4f0bb9f15c3e932287b8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:08.435436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d3da7b95b4f0bb9f15c3e932287b8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:08.436893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d3da7b95b4f0bb9f15c3e932287b8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:08.467363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d3da7b95b4f0bb9f15c3e932287b8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:08.495406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 935/1879] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:08 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:08.499833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.502981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d3da7b95b4f0bb9f15c3e932287b8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:08.506272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.564952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dee41-dc7d-4385-a0bb-05313a81b386 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.589662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 945/1880] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:08 2022] DELETE /identity/v3/users/5a0d3da7b95b4f0bb9f15c3e932287b8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:08.589662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.590046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.590955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.590955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.591171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.591852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.593473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cab6c-fd97-4937-b7cc-d2ef0f024b24 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.596777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.637976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 936/1881] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:08.639479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.639777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.640160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.671845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:08.699470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:08.700407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.794750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973912b-5575-49a1-b009-da309240c92e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.809282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.820137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.820137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.820438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.820931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.828616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.859953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 946/1882] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:08.859953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.865611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:08.876838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 937/1883] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:08.879274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:08.902359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc178af-606e-446b-ae9a-08e3a7c521d1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.909135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.910122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.910421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.911448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] PATH_INFO: `/v3/users/9dc57d6d120e413b92a13a25c7e9422d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.914303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc57d6d120e413b92a13a25c7e9422d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.916418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:08.932558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711ebe-6124-4cf6-929e-81206a1fdc0e None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:08.943934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:08.946526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:08.947051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:08.951651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:08.952438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:08.971117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:09.024116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:09.031073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc57d6d120e413b92a13a25c7e9422d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:09.033361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc57d6d120e413b92a13a25c7e9422d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:09.033632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 938/1884] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:09.034117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc57d6d120e413b92a13a25c7e9422d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:09.035341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:09.045491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.056176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc57d6d120e413b92a13a25c7e9422d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:09.070734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc57d6d120e413b92a13a25c7e9422d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:09.097854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5292-84d6-4b8e-8181-2807b2dcddff admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:09.112874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 947/1885] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:08 2022] DELETE /identity/v3/users/9dc57d6d120e413b92a13a25c7e9422d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:09.112874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:09.115142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.118521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:09.120299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.120786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.121201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.122144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:09.125162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:09.176286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 939/1886] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:09.178169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:09.186066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.218491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fffead-de9a-49f0-a026-69da3a670909 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:09.247922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532f7a-95ff-4548-8323-898cad01670f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:09.255684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:09.256323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.256600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.257670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.262263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.446311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:09.448079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4661d7-a967-4971-92d1-9c482b5cadaa service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:09.465120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:09.466042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.466042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.466252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] PATH_INFO: `/v3/projects/7d026722c3694900ac47939ea27d6e02/users/a48de89a188246b3b6958f47e6a1645a/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.486530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 948/1887] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:09.488077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c7f1-5efe-4acd-a559-846066c04a08 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.488676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c7f1-5efe-4acd-a559-846066c04a08 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.488676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c7f1-5efe-4acd-a559-846066c04a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.505210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d026722c3694900ac47939ea27d6e02, user_id=a48de89a188246b3b6958f47e6a1645a, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:09.508321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:09.540560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7237c7f1-5efe-4acd-a559-846066c04a08 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:09.545040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 940/1888] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:09 2022] PUT /identity/v3/projects/7d026722c3694900ac47939ea27d6e02/users/a48de89a188246b3b6958f47e6a1645a/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:09.545890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:09.546535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7237c7f1-5efe-4acd-a559-846066c04a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.667514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e100ad-576b-4dbf-8a30-b79311ec2fde admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:09.673376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 949/1889] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:09.676244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a376e-3292-4017-9c27-1d42be399645 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.677644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a376e-3292-4017-9c27-1d42be399645 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.677972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a376e-3292-4017-9c27-1d42be399645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.679852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:09.680638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.680969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.681287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] PATH_INFO: `/v3/projects/de2b1ce86c774c26b24283fcd2a8f000/users/418e3ef929b244728af32dbfdf06a8ea/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.708705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:09.742386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2b1ce86c774c26b24283fcd2a8f000, user_id=418e3ef929b244728af32dbfdf06a8ea, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:09.752176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21d3e4-3053-47af-94c4-02ead364b829 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:09.776187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:09.795332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-239a376e-3292-4017-9c27-1d42be399645 None None] MFA Rules not processed for user `a48de89a188246b3b6958f47e6a1645a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:09.806240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-239a376e-3292-4017-9c27-1d42be399645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.808799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 941/1890] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:09 2022] PUT /identity/v3/projects/de2b1ce86c774c26b24283fcd2a8f000/users/418e3ef929b244728af32dbfdf06a8ea/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:09.819929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:09.820464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:09.820941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:09.906519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] MFA Rules not processed for user `418e3ef929b244728af32dbfdf06a8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:09.909543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:09.997210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 950/1891] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:09.998200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a376e-3292-4017-9c27-1d42be399645 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.072449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 942/1892] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:10.075053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.145875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a376e-3292-4017-9c27-1d42be399645 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.159446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.160223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.161578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.162011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.233105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac455afb-1225-4d7b-96ee-bcf960000fa7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.248587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.249578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.249578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.249936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.250585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.256625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.341410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.346692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.352242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 943/1893] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:10 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:10.353159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.370201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 951/1894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:10.374840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.393672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502b799-811a-4815-8f76-61db360db709 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.477735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:10.495175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd56c6-e751-4b6a-9c0f-1e13db0dbfdc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.499740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.500501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.500916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.501357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.502048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.504140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.508750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.509405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.509669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.509946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.510578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.512556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.534895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:10.536431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 952/1895] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:10 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:10.540650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.567209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f4b5e-c8c5-476d-a579-f9db4b72a9ff admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.573592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.574351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.574666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.574949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.575824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.577571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.582159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 944/1896] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:10 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:10.585562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.590326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 953/1897] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:10.594459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.672204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ef3e-0ae3-460a-b52b-4cbcdcc05933 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.817156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d755-ed75-4dd2-9b93-939b7e3b515b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:10.820584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.822204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.822503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.823234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] PATH_INFO: `/v3/projects/80fba1f166994a5397b3860c221c08f4/users/283f258cb0f0480aad76598560a59eea/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.832282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:10.835840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:10.836126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:10.836400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:10.837062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.845222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.856380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fba1f166994a5397b3860c221c08f4, user_id=283f258cb0f0480aad76598560a59eea, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:10.860601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:10.910591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 954/1898] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:10 2022] PUT /identity/v3/projects/80fba1f166994a5397b3860c221c08f4/users/283f258cb0f0480aad76598560a59eea/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:10.912318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.913796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 945/1899] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:10 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:10.917053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:10.947524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab63ef-645b-4248-ab7d-59222fbc81d3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.117221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.117883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.118146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.118419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.119086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.120767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329f2f-60f4-4e14-b462-1c4e0de9f369 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.150547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 946/1900] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:11.152203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.155540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.155881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.164565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 947/1901] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:14:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:14:11.165473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.175079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.184259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050180e3-6623-49dd-b6b6-48ebf4bc5ec5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.209154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.210179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.210847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.211967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.213565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.218748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.241296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574272f-c98e-4863-bb10-18435acd03d9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.253600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 955/1902] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:11.253600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.257784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.258332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.258591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.258865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] PATH_INFO: `/v3/projects/19f52774f84a45959c9d9c15b3483ea2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.268347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f52774f84a45959c9d9c15b3483ea2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.270266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.281616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd92a7-634f-4eec-8349-f36821f2bd33 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.301143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.302027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.302433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.302864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] PATH_INFO: `/v3/projects/9cbb2d08836140b3993454b7cdd71fcd/users/92c42fdaa2d847a29525625aa80c3650/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.333271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbb2d08836140b3993454b7cdd71fcd, user_id=92c42fdaa2d847a29525625aa80c3650, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.340106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1894-12c7-4eb2-9da5-a19c30bf88a9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.365729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 956/1903] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:11 2022] PUT /identity/v3/projects/9cbb2d08836140b3993454b7cdd71fcd/users/92c42fdaa2d847a29525625aa80c3650/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:11.368193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.370106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.370526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.420315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:11.421247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f52774f84a45959c9d9c15b3483ea2', 'request_id': 'req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.422782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.437923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f52774f84a45959c9d9c15b3483ea2', 'request_id': 'req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.450192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f52774f84a45959c9d9c15b3483ea2', 'request_id': 'req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.468617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:11.473315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:11.477999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] The token cache is being invalidate because project 19f52774f84a45959c9d9c15b3483ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:11.479657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.481264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.487429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 948/1904] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:11 2022] DELETE /identity/v3/projects/19f52774f84a45959c9d9c15b3483ea2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:11.489314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.493088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.585566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 957/1905] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:11.588448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.592820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.631063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fa-14d1-4226-9c3f-62f4fa1f1a16 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.639629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bed430-9c39-4c40-bd3b-8ed2c2a8bf31 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.643537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.644247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.644524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.644791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] PATH_INFO: `/v3/projects/80fba1f166994a5397b3860c221c08f4/users/283f258cb0f0480aad76598560a59eea/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.653843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fba1f166994a5397b3860c221c08f4, user_id=283f258cb0f0480aad76598560a59eea, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.657478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.658282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.658663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.659055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.660043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.661599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.665598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.682353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 958/1906] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:11.683785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.685616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.686461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 949/1907] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:11 2022] PUT /identity/v3/projects/80fba1f166994a5397b3860c221c08f4/users/283f258cb0f0480aad76598560a59eea/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:11.700414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:11.704066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3202-2885-4e45-918e-aeff8afb258c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.838460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.840001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.840525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.841128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] PATH_INFO: `/v3/users/bb5cbd2525ef4eee8af876341377f384` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.843611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5cbd2525ef4eee8af876341377f384)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.849085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.874643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad2888-0550-48a4-a2af-5ed52207152d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:11.881689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:11.882434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.882671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.882948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] PATH_INFO: `/v3/projects/9cbb2d08836140b3993454b7cdd71fcd/users/92c42fdaa2d847a29525625aa80c3650/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.885067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbb2d08836140b3993454b7cdd71fcd, user_id=92c42fdaa2d847a29525625aa80c3650, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:11.888344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a8efa-ed66-4d5b-9bef-3d5a7d10588e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:11.919262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 950/1908] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:11 2022] PUT /identity/v3/projects/9cbb2d08836140b3993454b7cdd71fcd/users/92c42fdaa2d847a29525625aa80c3650/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:11.919262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:11.919262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:11.919262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:11.946730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5cbd2525ef4eee8af876341377f384'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.955982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5cbd2525ef4eee8af876341377f384'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.957134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5cbd2525ef4eee8af876341377f384'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.974155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5cbd2525ef4eee8af876341377f384'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:11.981254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] MFA Rules not processed for user `283f258cb0f0480aad76598560a59eea`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:11.982650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:11.983608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f728d3bc-e574-45ec-b0dc-8bc2bbfd6fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5cbd2525ef4eee8af876341377f384'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:12.022805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 959/1909] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:11 2022] DELETE /identity/v3/users/bb5cbd2525ef4eee8af876341377f384 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:12.024686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd690-5e53-43d3-9bdf-55c480bb8c41 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.025497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd690-5e53-43d3-9bdf-55c480bb8c41 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.025978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bd690-5e53-43d3-9bdf-55c480bb8c41 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.027487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 960/1910] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:14:12.028952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539dc94-8a2d-43bc-96b3-37e74221c6e3 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.029393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539dc94-8a2d-43bc-96b3-37e74221c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.029811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539dc94-8a2d-43bc-96b3-37e74221c6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.071291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6539dc94-8a2d-43bc-96b3-37e74221c6e3 None None] MFA Rules not processed for user `92c42fdaa2d847a29525625aa80c3650`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:12.073196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6539dc94-8a2d-43bc-96b3-37e74221c6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.089594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:12.194219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 961/1911] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:12.197174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.197174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.198469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.231436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:12.233248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.267689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 951/1912] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:12.268777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:12.270371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.301596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:12.364498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 962/1913] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:12.369647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:12.372614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.440703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be748c10-51a8-408f-b7c5-75b26c9945e3 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:12.494676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51140d04-e4ef-428d-8f9e-aac147139461 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:12.509230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:12.510057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.510057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.510410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.605773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:12.611677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.611677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.611677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.617554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.671524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:12.682219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:12.684394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:12.705774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 963/1914] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:12.723048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:12.732006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.827903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:12.829945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:12.867412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 952/1915] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:12.869216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:12.873876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.914857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2675cf-531b-4c0f-ac3a-654fd551972f service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:12.921980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:12.923287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.923795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.924271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.926758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:12.961615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:12.964458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:12.964737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8669-97b6-4ae4-960b-f1cbe51e33d0 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:12.987391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:12.987391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:12.987391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:12.987391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] PATH_INFO: `/v3/projects/2f5ed9cb38f544fcbd44c95dcd9b1b29` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:12.987909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5ed9cb38f544fcbd44c95dcd9b1b29)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:12.987909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:13.022590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 953/1916] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:13.025887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:13.060601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4c1c1-bce4-46b1-9ed8-9ae2ce10a459 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:13.074826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:13.075651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:13.076223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:13.076328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:13.084172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:13.132547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5ed9cb38f544fcbd44c95dcd9b1b29', 'request_id': 'req-80e84448-0ebe-45bc-998d-103c75e18036'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.146547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5ed9cb38f544fcbd44c95dcd9b1b29', 'request_id': 'req-80e84448-0ebe-45bc-998d-103c75e18036'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.168375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5ed9cb38f544fcbd44c95dcd9b1b29', 'request_id': 'req-80e84448-0ebe-45bc-998d-103c75e18036'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.207084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:13.210218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:13.214377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] The token cache is being invalidate because project 2f5ed9cb38f544fcbd44c95dcd9b1b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:13.214917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.216927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.222270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 964/1917] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:12 2022] DELETE /identity/v3/projects/2f5ed9cb38f544fcbd44c95dcd9b1b29 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:13.223379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:13.226398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:13.235219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 954/1918] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:13.237640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:13.269208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026f3ba-b074-46d4-83dd-4c9883bce038 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:13.279628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:13.497951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e84448-0ebe-45bc-998d-103c75e18036 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:13.531019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:13.536866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:13.537399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:13.540838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:13.545838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:13.552078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:13.570939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:13.571407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:13.571750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] PATH_INFO: `/v3/users/c04264981c8f4972a29ff9dc6f03fa92` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:13.578032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04264981c8f4972a29ff9dc6f03fa92)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:13.594190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:13.605909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:13.614958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:13.661756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 965/1919] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:13.898102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04264981c8f4972a29ff9dc6f03fa92'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.925802 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04264981c8f4972a29ff9dc6f03fa92'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.943874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04264981c8f4972a29ff9dc6f03fa92'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:13.948224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04264981c8f4972a29ff9dc6f03fa92'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.018982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1f490280-ed60-41b2-91e8-c20bbf3ecfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04264981c8f4972a29ff9dc6f03fa92'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.046326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 955/1920] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:13 2022] DELETE /identity/v3/users/c04264981c8f4972a29ff9dc6f03fa92 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:14.072181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:14.074993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:14.105129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f226f-d0c8-488a-b952-5e77cb45be5a service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:14.125362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:14.336327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:14.338407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:14.338667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:14.339635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] PATH_INFO: `/v3/projects/b604bde9115440adaec078523f7dd537` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:14.341755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b604bde9115440adaec078523f7dd537)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:14.351810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:14.499031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b604bde9115440adaec078523f7dd537', 'request_id': 'req-890c7524-a941-43c3-9f1e-9b73725f5d52'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.507814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b604bde9115440adaec078523f7dd537', 'request_id': 'req-890c7524-a941-43c3-9f1e-9b73725f5d52'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.525638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b604bde9115440adaec078523f7dd537', 'request_id': 'req-890c7524-a941-43c3-9f1e-9b73725f5d52'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.546109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] The token cache is being invalidate because project b604bde9115440adaec078523f7dd537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:14.547647 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.548659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-890c7524-a941-43c3-9f1e-9b73725f5d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:14.551923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 966/1921] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:14 2022] DELETE /identity/v3/projects/b604bde9115440adaec078523f7dd537 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:14.556669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:14.557218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:14.557218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:14.597877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:14.599153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:14.783706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 956/1922] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:14.786733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:14.787130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:14.787537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:14.814976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:14.816774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:14.831968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 967/1923] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:14.833046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:14.845591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57841-cea3-4b08-b378-0dce3e194e92 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:14.860933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:14.862152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:14.862583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:14.862992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:14.866342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:14.867809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:14.872561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:14.930141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:14.930711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 957/1924] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:14.952015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cfedf-2901-4f4d-8288-d42a3b3fc0e2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:14.962087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:14.963763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:14.964051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:14.966073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:14.966555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:14.970461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:15.057558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 968/1925] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:14 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:15.063342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.095479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fef50-6440-4f30-9078-2f13ec170eb7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:15.146108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:15.325052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:15.327213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.328390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.328964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.331709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:15.340476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:15.420437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 958/1926] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:15 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:15.424752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.442969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b56b-f261-4449-bb07-2f3a613a1b73 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:15.455933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:15.458398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.459538 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.460663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.463122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:15.470738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:15.502006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 969/1927] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:15.505935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.523682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ffb1-e1f0-4bb3-9f71-7a1346cee7df admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:15.542700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:15.543667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.545444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.545948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.548185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:15.550949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91be79-7e5a-4dfe-b60e-d337f3b826cb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:15.582317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 959/1928] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:15.586938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.601061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593459d-d555-4b47-97bb-5007126c2a87 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:15.628487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:15.629283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.629567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.629806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] PATH_INFO: `/v3/projects/6b941f74b1aa43c8a6dd3a67d17051ed/users/8180313358bc4950843ebe4457bdf2a3/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.663710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b941f74b1aa43c8a6dd3a67d17051ed, user_id=8180313358bc4950843ebe4457bdf2a3, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:15.668284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:15.699283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 970/1929] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:15 2022] PUT /identity/v3/projects/6b941f74b1aa43c8a6dd3a67d17051ed/users/8180313358bc4950843ebe4457bdf2a3/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:15.709752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108670ac-bc98-436d-becd-abae77a40170 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.710367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108670ac-bc98-436d-becd-abae77a40170 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.710709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108670ac-bc98-436d-becd-abae77a40170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.789094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-108670ac-bc98-436d-becd-abae77a40170 None None] MFA Rules not processed for user `8180313358bc4950843ebe4457bdf2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:15.790354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-108670ac-bc98-436d-becd-abae77a40170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:15.877764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 960/1930] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:15.881531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.895980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108670ac-bc98-436d-becd-abae77a40170 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:15.899628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-108670ac-bc98-436d-becd-abae77a40170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:15.950338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:15.983170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe852c9-a362-4490-ae97-c33bcce4af29 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:15.990244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:15.991110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:15.991576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:15.992018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:15.993321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:15.995973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.004874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108670ac-bc98-436d-becd-abae77a40170 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.011698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.013099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.013496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.013903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] PATH_INFO: `/v3/projects/0a19ebd1f1a0407c837b1145830e4f27` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.015633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a19ebd1f1a0407c837b1145830e4f27)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.019643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.052832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:16.085768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 971/1931] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:15 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:16.089307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.100275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a19ebd1f1a0407c837b1145830e4f27', 'request_id': 'req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:16.108231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a19ebd1f1a0407c837b1145830e4f27', 'request_id': 'req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:16.117045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a19ebd1f1a0407c837b1145830e4f27', 'request_id': 'req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:16.136555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] The token cache is being invalidate because project 0a19ebd1f1a0407c837b1145830e4f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:16.136870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:16.137672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d335c39b-e1b5-4d84-8ad6-4ec2d70638ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:16.139789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 961/1932] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:15 2022] DELETE /identity/v3/projects/0a19ebd1f1a0407c837b1145830e4f27 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:16.144304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.144703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.144968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.177291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:16.178635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.182338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4ae2-b2be-4cfd-9ede-842350f1b9dd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.188094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.188880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 962/1933] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:16.189079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.189449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.189721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.189977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.190409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.192600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309673b-fa6e-4aff-9ad0-ccd84ed1ab0a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.197866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.224407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 972/1934] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:16.225856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.226146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.226410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.280405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:16.281646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.289158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2083f7-7e3b-4a67-bf41-ce1a9a30b246 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.291141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 973/1935] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:16.292005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.293267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.294179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.295098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.295572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.296030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.298115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.306057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fbfc0-f185-4f8c-8604-eed9fb7b1df2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.311327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.311949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.312224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.312491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.313388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.315735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.329376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 974/1936] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:16.329376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.337321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1dbe8-2dd8-4a31-8c55-a26b264164d2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.342418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.343013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.343322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.343607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.344295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:16.344569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.346176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.359137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 975/1937] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:16.359524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.369465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98660c0-cbca-456e-a200-fb4709b8215e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.374386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.375511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.375511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.375729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] PATH_INFO: `/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7/users/f9ae8d3bfb0c450a8c58ffa407e0ad71/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.383168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.384830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.390956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b617ea5960e04fc7ba00dfbc389b1dc7, user_id=f9ae8d3bfb0c450a8c58ffa407e0ad71, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.393706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.395996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 963/1938] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:16.397083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.408192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88db7-3398-440c-8e53-136f43bc2fc6 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.420553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 976/1939] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:16 2022] PUT /identity/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7/users/f9ae8d3bfb0c450a8c58ffa407e0ad71/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:16.425024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.478503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:16.501836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.502478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.502762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.503142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.503812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.505764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.507145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:16.522104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20846-ef57-42c1-8d9d-acef5bcfc604 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.527139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.527825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.528105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.528378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.529032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.530718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.544736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 977/1940] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:16.549557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.565973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833bb4b-1bb5-4f38-85e6-94ffd5a59096 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.567710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 964/1941] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:16.568861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.663960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae8b1-87b9-4fb2-9308-6baad63cd957 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.666155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.666848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.667141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.667465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] PATH_INFO: `/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7/users/f9ae8d3bfb0c450a8c58ffa407e0ad71/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.669913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b617ea5960e04fc7ba00dfbc389b1dc7, user_id=f9ae8d3bfb0c450a8c58ffa407e0ad71, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.672702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018f8c-ee35-4eca-89b6-01b2daa92067 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.681715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.683554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.684090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.685552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.686221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.691544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.696125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 978/1942] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:16 2022] PUT /identity/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7/users/f9ae8d3bfb0c450a8c58ffa407e0ad71/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:16.708696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.708977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.709249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.731825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 965/1943] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:16.733092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.745490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] MFA Rules not processed for user `f9ae8d3bfb0c450a8c58ffa407e0ad71`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:16.747088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:16.761241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8158e5-218b-42f3-ba26-a5f6c115ce13 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.895305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 979/1944] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:16.917062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.943426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.944167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.944522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.944704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.945562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.947273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.958894 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 966/1945] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:16.963151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:16.974900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb40f14-28ef-4630-86fc-65a3c09cfe32 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.981518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.982068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.982349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.982629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:16.983317 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:16.985380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:16.992028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70e2f9-b778-4d17-ae6e-fa367b2ef755 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:16.996171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:16.997239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:16.997239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:16.997458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 967/1946] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:16.997548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.002123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.012936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.013591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a458d-7f21-4690-bc7f-8735f4eee669 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.015240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eeb86-7465-4434-b86b-1befb202b1a6 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.018874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.019624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.019879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.020174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] PATH_INFO: `/v3/projects/01f44dc6d68f49e4ad377d1f39b48821/users/6becd0b993d445e09739f3626e514a18/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.027211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 980/1947] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:17.038806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f44dc6d68f49e4ad377d1f39b48821, user_id=6becd0b993d445e09739f3626e514a18, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.042771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.061083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 968/1948] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:17 2022] PUT /identity/v3/projects/01f44dc6d68f49e4ad377d1f39b48821/users/6becd0b993d445e09739f3626e514a18/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:17.077485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.084676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.085037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.121996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:17.126646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] MFA Rules not processed for user `6becd0b993d445e09739f3626e514a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:17.128813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:17.231312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 981/1949] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:17.234342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.306104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:17.376345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa4c82-8c39-4903-8966-88ae9ccd910a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.382902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.384741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.385130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.385501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.387995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.392798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.444566 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 969/1950] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:17 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:17.446642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.461368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae292020-c31c-4254-99c7-a9e5fc59e0ef None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.582258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.583002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.583404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.584824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.585880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.587852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.622741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.637728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 982/1951] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:17 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:17.641503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.653326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774aec8e-6bfe-42df-8050-394c727e5a6b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.659403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.660094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.660372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.660645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] PATH_INFO: `/v3/users/8180313358bc4950843ebe4457bdf2a3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.662003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8180313358bc4950843ebe4457bdf2a3)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.664702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.683279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c243-1407-41c4-a8b6-b9a57b95f361 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.692928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.693934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.694407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.695079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.696072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.700415 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.731032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 983/1952] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:17.737712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.751157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8180313358bc4950843ebe4457bdf2a3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:17.759113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760738e-0663-47ce-8b78-5197db7c7d01 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.770026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.770693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.771230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.772896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8180313358bc4950843ebe4457bdf2a3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:17.775387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.779911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:17.783810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:17.787239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8180313358bc4950843ebe4457bdf2a3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:17.788752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8180313358bc4950843ebe4457bdf2a3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:17.808077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 984/1953] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:17.815444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:17.820653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:17.823744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8b2a0f0d-0702-4cee-b358-c2a45a932e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8180313358bc4950843ebe4457bdf2a3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:17.836516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 970/1954] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:17 2022] DELETE /identity/v3/users/8180313358bc4950843ebe4457bdf2a3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:17.841553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.841838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.842108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:17.850436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bd4f-8664-4ff3-a27e-d009751fde3b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:17.892831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:17.894090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:17.972437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:17.973274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:17.973542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:17.973817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] PATH_INFO: `/v3/projects/49ce36f6401543cbaf7b1f0cef7c2976/users/d24f4592da154f6ea57ad406d1f58f0a/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.010207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ce36f6401543cbaf7b1f0cef7c2976, user_id=d24f4592da154f6ea57ad406d1f58f0a, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.010571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 971/1955] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:18.013170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c66ee4-cfc1-418e-84b0-458ddd9fee81 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.016697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:18.027970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.030095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:18.043641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 985/1956] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:17 2022] PUT /identity/v3/projects/49ce36f6401543cbaf7b1f0cef7c2976/users/d24f4592da154f6ea57ad406d1f58f0a/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:18.055826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.056341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.057353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.094684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] MFA Rules not processed for user `d24f4592da154f6ea57ad406d1f58f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:18.096072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:18.111439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:18.160949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e260231-1335-45ca-9447-c2a333c130b9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.214028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 986/1957] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:18.214931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.235273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.235827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.239580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.239994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.298196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5d01d-6522-4b50-9362-67e0e378a5b2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.306419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.307458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.307922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.308355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.309402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.312708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.329808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.331559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.361037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 972/1958] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:18.374080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 987/1959] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:18 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:18.378557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.394208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5c53-f772-45f2-a381-a3f253a30941 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.456652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.457503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.457814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.458505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.459515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.462161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.488237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 973/1960] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:18 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:18.492381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.505897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2b947-6b6e-4c7a-991d-30af6e99cbe6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.511911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.512496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.512728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.512997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.513768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.515557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.531363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 988/1961] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:18.535536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.547090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94fe7-8c08-4351-8334-beb3a82201d2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.552746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.553430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.553711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.553997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] PATH_INFO: `/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26/users/c5b48837549e4fa19e98211a338cce26/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.571734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1b2ce4575409f8f866f3bafa58a26, user_id=c5b48837549e4fa19e98211a338cce26, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.574697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.586180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:18.592602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 974/1962] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:18 2022] PUT /identity/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26/users/c5b48837549e4fa19e98211a338cce26/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:18.600289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.623951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd59e5-d8dc-4b57-8dfd-05c9cc138623 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.692492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:18.706001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.707051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.707742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.708105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.709170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.711955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc4309-3097-45e5-a4f6-7fcb21aec376 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.722783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 989/1963] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:18.727716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.740410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4714a-f5cc-4ecf-a941-d7a2444af7a2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.745862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.746554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.746972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.747281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] PATH_INFO: `/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26/users/c5b48837549e4fa19e98211a338cce26/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.749559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1b2ce4575409f8f866f3bafa58a26, user_id=c5b48837549e4fa19e98211a338cce26, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.752314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.764560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 975/1964] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:18 2022] PUT /identity/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26/users/c5b48837549e4fa19e98211a338cce26/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:18.777253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.777736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.778066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.809151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] MFA Rules not processed for user `c5b48837549e4fa19e98211a338cce26`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:18.810395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:18.825247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.827952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:18.901187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 990/1965] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:18.913377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:18.914804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:18.929285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d661d0-2fbe-46c6-b837-edaaa100bdd1 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.933812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.934447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.934718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.934984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] PATH_INFO: `/v3/projects/6b941f74b1aa43c8a6dd3a67d17051ed` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.936230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b941f74b1aa43c8a6dd3a67d17051ed)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.938287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.972676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc33c5-85c4-4b8d-93ed-a21e4603052b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:18.976297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:18.976939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:18.977214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:18.977484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:18.986402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:18.987874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:18.989662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b941f74b1aa43c8a6dd3a67d17051ed', 'request_id': 'req-f102a286-905e-4a29-bb1f-10e1454ef4d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:18.996074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b941f74b1aa43c8a6dd3a67d17051ed', 'request_id': 'req-f102a286-905e-4a29-bb1f-10e1454ef4d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:18.997843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 991/1966] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:19.002271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b941f74b1aa43c8a6dd3a67d17051ed', 'request_id': 'req-f102a286-905e-4a29-bb1f-10e1454ef4d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.019125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] The token cache is being invalidate because project 6b941f74b1aa43c8a6dd3a67d17051ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:19.019434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.020069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.021607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 976/1967] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:18 2022] DELETE /identity/v3/projects/6b941f74b1aa43c8a6dd3a67d17051ed => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:19.026070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:19.036499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71482a-1e09-4bca-b28d-6e544b4d8a50 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:19.093880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:19.094783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:19.094944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:19.095304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] PATH_INFO: `/v3/users/f9ae8d3bfb0c450a8c58ffa407e0ad71` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:19.097029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ae8d3bfb0c450a8c58ffa407e0ad71)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:19.098987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:19.122833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:19.149913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ae8d3bfb0c450a8c58ffa407e0ad71'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.151097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ae8d3bfb0c450a8c58ffa407e0ad71'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.151764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ae8d3bfb0c450a8c58ffa407e0ad71'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.161163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ae8d3bfb0c450a8c58ffa407e0ad71'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.172456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ae8d3bfb0c450a8c58ffa407e0ad71'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.196141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 992/1968] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:19 2022] DELETE /identity/v3/users/f9ae8d3bfb0c450a8c58ffa407e0ad71 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:19.509563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:19.511781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:19.527319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102a286-905e-4a29-bb1f-10e1454ef4d6 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:19.631698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:19.632464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:19.632840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:19.633232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] PATH_INFO: `/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:19.634835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b617ea5960e04fc7ba00dfbc389b1dc7)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:19.636833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:19.690065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:19.739983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b617ea5960e04fc7ba00dfbc389b1dc7', 'request_id': 'req-589e5ef9-8497-4b5a-9623-b362de256d8d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.743858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:19.745327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:19.748069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b617ea5960e04fc7ba00dfbc389b1dc7', 'request_id': 'req-589e5ef9-8497-4b5a-9623-b362de256d8d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.754215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b617ea5960e04fc7ba00dfbc389b1dc7', 'request_id': 'req-589e5ef9-8497-4b5a-9623-b362de256d8d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.774755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde635-61bb-40de-bf6e-45cb8aab54f1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:19.776298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] The token cache is being invalidate because project b617ea5960e04fc7ba00dfbc389b1dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:19.776478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.777970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-589e5ef9-8497-4b5a-9623-b362de256d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.783439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 977/1969] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:19 2022] DELETE /identity/v3/projects/b617ea5960e04fc7ba00dfbc389b1dc7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:19.785011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:19.787428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:19.787714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:19.830044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:19.831373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:19.894593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:19.895264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:19.895541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:19.895809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] PATH_INFO: `/v3/users/a48de89a188246b3b6958f47e6a1645a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:19.897917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48de89a188246b3b6958f47e6a1645a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:19.901699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:19.914229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 978/1970] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:19.915194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:19.916947 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:19.972698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48de89a188246b3b6958f47e6a1645a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.973407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48de89a188246b3b6958f47e6a1645a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.974012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48de89a188246b3b6958f47e6a1645a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.983642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48de89a188246b3b6958f47e6a1645a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:19.993029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37dab3-6a3a-4ef2-be48-fb1a55a54dfb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:19.996989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:19.997607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:19.997912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:19.998235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:19.999618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9ce4d8b0-93a4-4f5f-bd3c-6166d9a760dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48de89a188246b3b6958f47e6a1645a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:20.000061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:20.021550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 993/1971] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:19 2022] DELETE /identity/v3/users/a48de89a188246b3b6958f47e6a1645a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:20.023163 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.023552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.023922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.046942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:20.048370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:20.065700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:20.070394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.072664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c569c2-eda2-47b7-89cf-d61a10d3b7f7 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.083715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 979/1972] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:20.084981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.085264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.085595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.092953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:20.112113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:20.114495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:20.133788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 994/1973] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:20.137524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.146701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5dc34-fde2-4281-99bb-dad985a2c1bb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.152162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.152768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.153048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.153318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.153977 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:20.154277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.156103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.169221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 995/1974] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:20.173504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.183162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9087-65f3-4297-b39e-335ef7b7c0ff admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.184132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 980/1975] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:20.188091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.188773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.189114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.189454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.190180 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.192218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.194332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.195828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:20.226321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 996/1976] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:20.231001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.275890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4869-7b12-4081-8c5e-ab7ecff82ccf None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.304349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afd31c-e192-42ce-a0c4-2cb11127edde admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.310209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.310941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.311212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.311518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.312166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.314363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.332890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.334261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.334543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.334810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.341985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 997/1977] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:20.355378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.355378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.357889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.362403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 981/1978] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:20.371327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08084-69b7-4ad7-9481-27d264bfd536 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.377106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.377800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.378149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.378916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.379704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.381506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.393434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 998/1979] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:20.398090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.410813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411a2bf-9e53-42c9-9e83-9c497487d7b1 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.434632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.436619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.437542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.438198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.439798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.442875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0953138-a071-4838-bac6-27495ca4cd25 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.463586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.464139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 982/1980] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:20.478895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515493e0-4153-43c3-9aa0-054d48520dc4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.486726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.487956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.488329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.488700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] PATH_INFO: `/v3/projects/6a46ac04c57a41eeaf4e8da9baf35051/users/01a825a17d8044caad2a49d668c6d7f7/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.513560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a46ac04c57a41eeaf4e8da9baf35051, user_id=01a825a17d8044caad2a49d668c6d7f7, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.519222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.552413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 999/1981] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:20 2022] PUT /identity/v3/projects/6a46ac04c57a41eeaf4e8da9baf35051/users/01a825a17d8044caad2a49d668c6d7f7/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:20.564815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.565049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.565332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.605353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] MFA Rules not processed for user `01a825a17d8044caad2a49d668c6d7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:20.606735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:20.669902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:20.732841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 983/1982] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:20.738260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.785173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:20.806585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d156-c95c-4c7b-bcda-22e480389f59 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.812598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.813426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.813703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.813976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.814633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.816577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.852775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1000/1983] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:20.856874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:20.868297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e25d7-cce7-4a90-a994-b958f3748c50 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:20.948868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:20.949624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:20.949975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:20.950324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:20.951061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:20.953104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:20.984551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 984/1984] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:20 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:20.989737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.002469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca9848-17a4-4139-a2bc-6c4b5f68b2a3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.011779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.012769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.013447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.013925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.015048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.017603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.033141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1001/1985] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:21.038148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.048888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df45ea-c784-41d4-b262-d137599df10d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.053937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.054645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.054925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.055222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] PATH_INFO: `/v3/projects/bf401bde3ab64640858cd292b2171f25/users/8f2804fcd30e429494dc1199ad732178/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.074966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf401bde3ab64640858cd292b2171f25, user_id=8f2804fcd30e429494dc1199ad732178, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.078040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.112863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 985/1986] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:21 2022] PUT /identity/v3/projects/bf401bde3ab64640858cd292b2171f25/users/8f2804fcd30e429494dc1199ad732178/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:21.116319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.127847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c5e04-5e34-471e-a501-6a3fc0a36c26 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.229421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.230050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.230329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.230600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.231278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.232879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c6288-ef34-4526-92d0-bf87e025e5ce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.248968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1002/1987] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:21.253234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.264284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d256c4-9fda-441a-bd3f-0e3824093ecc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.269682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.270366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.270645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.270915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] PATH_INFO: `/v3/projects/bf401bde3ab64640858cd292b2171f25/users/8f2804fcd30e429494dc1199ad732178/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.273077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf401bde3ab64640858cd292b2171f25, user_id=8f2804fcd30e429494dc1199ad732178, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.276147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.287877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 986/1988] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:21 2022] PUT /identity/v3/projects/bf401bde3ab64640858cd292b2171f25/users/8f2804fcd30e429494dc1199ad732178/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:21.299443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.299620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.299840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.330080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] MFA Rules not processed for user `8f2804fcd30e429494dc1199ad732178`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:21.331374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:21.424637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.425984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1003/1989] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:21.426430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:21.437037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.439229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:21.489098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:21.513239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840ddaf-17a4-4cc0-b5e4-50841965d619 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.516991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.517623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.517948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.518225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.527375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2625-389a-4504-ab59-348da45ee752 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.535920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.537105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.537561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.537906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] PATH_INFO: `/v3/projects/7d026722c3694900ac47939ea27d6e02` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.539613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d026722c3694900ac47939ea27d6e02)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.541891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.580293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.582083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.589856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:21.593657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1004/1990] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:21.605986 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d026722c3694900ac47939ea27d6e02', 'request_id': 'req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.618298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d026722c3694900ac47939ea27d6e02', 'request_id': 'req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.628033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d026722c3694900ac47939ea27d6e02', 'request_id': 'req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.645659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] The token cache is being invalidate because project 7d026722c3694900ac47939ea27d6e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:21.646006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.646633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.651267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 987/1991] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:21 2022] DELETE /identity/v3/projects/7d026722c3694900ac47939ea27d6e02 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:21.653824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:21.668020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4db2f-e5bc-4550-96c8-48b59f7d0eea service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:21.728881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:21.729522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:21.729821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:21.730094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] PATH_INFO: `/v3/users/283f258cb0f0480aad76598560a59eea` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:21.731363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=283f258cb0f0480aad76598560a59eea)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:21.733332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:21.785249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283f258cb0f0480aad76598560a59eea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.786160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283f258cb0f0480aad76598560a59eea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.786894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283f258cb0f0480aad76598560a59eea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.797067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283f258cb0f0480aad76598560a59eea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.804945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-40f5d197-7c19-41e0-98d6-ecc22c10f78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283f258cb0f0480aad76598560a59eea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:21.826121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1005/1992] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:21 2022] DELETE /identity/v3/users/283f258cb0f0480aad76598560a59eea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:22.167148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.169474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:22.195786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23d4d7-dff9-4d4f-8435-5bf9017d206a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.292907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.292907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.292907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.292907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] PATH_INFO: `/v3/projects/80fba1f166994a5397b3860c221c08f4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.294298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fba1f166994a5397b3860c221c08f4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.296158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.352702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fba1f166994a5397b3860c221c08f4', 'request_id': 'req-65df8364-7674-4732-8575-784b3478b47b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:22.358969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fba1f166994a5397b3860c221c08f4', 'request_id': 'req-65df8364-7674-4732-8575-784b3478b47b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:22.365548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fba1f166994a5397b3860c221c08f4', 'request_id': 'req-65df8364-7674-4732-8575-784b3478b47b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:22.392125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] The token cache is being invalidate because project 80fba1f166994a5397b3860c221c08f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:22.392595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:22.393387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65df8364-7674-4732-8575-784b3478b47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:22.398235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 988/1993] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:22 2022] DELETE /identity/v3/projects/80fba1f166994a5397b3860c221c08f4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:22.400295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.400595 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.400867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.420772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:22.422016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:22.426483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:22.499511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1006/1994] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:22.507302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.507768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.508266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.529784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:22.531038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:22.539358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 989/1995] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:22.548404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.559915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a5c7-8b01-4191-a4d0-19e5fb4f4189 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.567569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.568390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.568503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.568750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.569421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:22.569833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.571633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.583790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1007/1996] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:22.588088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.597290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729b674-3d49-49e9-a10e-2e34b60ca702 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.601862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.602466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.602742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.603009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.603685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.605604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.639333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 990/1997] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:22 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:22.643870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.654972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba4083-bce3-4104-a083-03506f68687d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.738331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.739378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.739875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.740405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.741454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.744671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.781887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1008/1998] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:22 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:22.783513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.794138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34493c-4f82-4bad-b172-d11d16e31f41 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.798753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.799388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.799663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.799934 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.800583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.802183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.814156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 991/1999] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:22.818117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.829055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7326c-29dd-4f4b-8b1f-380cad9d829b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.834045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.834666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.835080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.835394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.836188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.837805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34563943-e8eb-4c18-aabf-a41cc7d45839 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.849836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1009/2000] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:22.853993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:22.869005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc60bc-b5c0-4937-a6b1-f838a80fa27c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:22.874390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:22.875220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.875619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.875940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] PATH_INFO: `/v3/projects/9b904e038d8c4c29a48400514bc1e83c/users/a8e4a50f509147f08e6c7b3e9fa30e11/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.892172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:22.899548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b904e038d8c4c29a48400514bc1e83c, user_id=a8e4a50f509147f08e6c7b3e9fa30e11, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:22.905427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:22.923497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 992/2001] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:22 2022] PUT /identity/v3/projects/9b904e038d8c4c29a48400514bc1e83c/users/a8e4a50f509147f08e6c7b3e9fa30e11/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:22.934450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:22.934751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:22.935032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:22.968387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] MFA Rules not processed for user `a8e4a50f509147f08e6c7b3e9fa30e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:22.969891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:23.056468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1010/2002] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:23.060799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.131639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c1f44-ba0c-4577-aa42-be63f1648ab5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.136564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.137193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.137447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.137713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.138370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.140309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.169790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 993/2003] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:23 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:23.174526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.182083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:23.188258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130eb46-4154-485b-b81c-bc318fed4833 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.250114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.250776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.251045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.251343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.251983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.253884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.282817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1011/2004] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:23 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:23.289433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.301277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3eda-d1cb-4e52-a066-15282bbcbbce admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.306882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.307676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.307958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.308224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.308881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.310535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.325788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 994/2005] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:23.332128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.350051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cccc1-d021-494c-ac43-28a031ad0cbc admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.358787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.360140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.360716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.361276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] PATH_INFO: `/v3/projects/9ca92a4102a14b18aca1505629550567/users/2286dd5c090744c58b315f3ca58d7221/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.390924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca92a4102a14b18aca1505629550567, user_id=2286dd5c090744c58b315f3ca58d7221, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.396657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.452388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1012/2006] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:23 2022] PUT /identity/v3/projects/9ca92a4102a14b18aca1505629550567/users/2286dd5c090744c58b315f3ca58d7221/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:23.457608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.479646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30683cf6-3f56-4b4b-83d7-71fbb6491a75 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.598781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.600296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.601319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.601575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.602667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.618793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27a699-8404-4418-b3d8-255ee3315de1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.653146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 995/2007] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:23.654586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.701336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec910d7-de6c-4772-a47d-af3f0e7d12cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.712395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.713654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.715004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.715795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] PATH_INFO: `/v3/projects/9ca92a4102a14b18aca1505629550567/users/2286dd5c090744c58b315f3ca58d7221/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.721435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca92a4102a14b18aca1505629550567, user_id=2286dd5c090744c58b315f3ca58d7221, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:23.728243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:23.750661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1013/2008] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:23 2022] PUT /identity/v3/projects/9ca92a4102a14b18aca1505629550567/users/2286dd5c090744c58b315f3ca58d7221/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:23.762512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.763144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.763675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.807347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] MFA Rules not processed for user `2286dd5c090744c58b315f3ca58d7221`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:23.809000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:23.871859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:23.908255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 996/2009] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:23.920639 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:23.923062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:23.984508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa605cf-b3da-4bb9-909f-abcedda30258 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:23.988791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:23.989438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:23.989725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:23.989996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:23.999713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:24.001149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:24.011568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1014/2010] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:24.087473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:24.097722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5f07-d303-4830-83d8-91016f8d5c6e None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:24.101571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:24.102184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:24.102455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:24.102724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:24.161188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:24.162653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:24.171608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 997/2011] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:24.309416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:24.318763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1a2c-0185-4f37-86ac-e8bf314dd25d service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:24.322635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:24.323398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:24.323746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:24.324079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:24.325869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:24.392028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:24.393685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb9293-de66-4478-9586-b4bb5e7efe07 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:24.397671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:24.405452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1015/2012] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:24.447832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:24.527885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788b77-c5c9-45c6-87f4-d2c30dde8d98 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:24.534752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:24.535962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:24.536629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:24.537019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] PATH_INFO: `/v3/users/a8e4a50f509147f08e6c7b3e9fa30e11` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:24.538530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e4a50f509147f08e6c7b3e9fa30e11)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:24.540533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:24.604913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e4a50f509147f08e6c7b3e9fa30e11'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:24.616264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e4a50f509147f08e6c7b3e9fa30e11'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:24.627511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e4a50f509147f08e6c7b3e9fa30e11'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:24.628231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e4a50f509147f08e6c7b3e9fa30e11'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:24.642272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e4a50f509147f08e6c7b3e9fa30e11'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:24.651715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 998/2013] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:24 2022] DELETE /identity/v3/users/a8e4a50f509147f08e6c7b3e9fa30e11 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:24.656376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99146e-55b3-4426-b6e2-0738afb48ce9 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:24.656739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99146e-55b3-4426-b6e2-0738afb48ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:24.657016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99146e-55b3-4426-b6e2-0738afb48ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:24.679637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8e99146e-55b3-4426-b6e2-0738afb48ce9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:24.680848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e99146e-55b3-4426-b6e2-0738afb48ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:24.788063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1016/2014] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:24.799937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:24.802040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:24.809981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:24.966305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b2c9c-00d3-472e-a2e2-55292bf97be8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:24.974653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:24.976302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:24.976638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:24.976848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:24.990886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:24.992888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24d6b3-0778-4db1-a1dc-9409d348bf39 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:25.006344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 999/2015] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:25.441239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:25.441731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:25.442206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:25.443752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1017/2016] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:14:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:14:25.462267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:25.463542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:25.464153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:25.510648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:25.514366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:25.642347 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1000/2017] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:14:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:25.655930 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:25.657577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:25.676331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17d9c-0eea-45af-bf7e-3d967ead8fb3 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:25.680348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:25.684039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:25.684620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:25.685531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:25.685836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:25.686277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:25.697525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:25.699431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:25.701671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb0e14-f218-4aad-916f-7dc7479edea5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:25.707474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:25.708121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:25.708386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:25.708656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] PATH_INFO: `/v3/projects/9b904e038d8c4c29a48400514bc1e83c` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:25.709814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b904e038d8c4c29a48400514bc1e83c)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:25.710883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1018/2018] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:25.711888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:25.762526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b904e038d8c4c29a48400514bc1e83c', 'request_id': 'req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.770074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b904e038d8c4c29a48400514bc1e83c', 'request_id': 'req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.777554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b904e038d8c4c29a48400514bc1e83c', 'request_id': 'req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.794032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] The token cache is being invalidate because project 9b904e038d8c4c29a48400514bc1e83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:25.794318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.795122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.797213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1001/2019] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:25 2022] DELETE /identity/v3/projects/9b904e038d8c4c29a48400514bc1e83c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:25.801957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:25.816392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717543a-4ea2-4c8c-9f1c-93954005c4ae service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:25.882371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:25.883023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:25.883353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:25.883623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] PATH_INFO: `/v3/users/2286dd5c090744c58b315f3ca58d7221` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:25.884774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2286dd5c090744c58b315f3ca58d7221)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:25.886852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:25.939751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2286dd5c090744c58b315f3ca58d7221'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.940326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2286dd5c090744c58b315f3ca58d7221'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.941018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2286dd5c090744c58b315f3ca58d7221'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.949802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2286dd5c090744c58b315f3ca58d7221'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.957843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2286dd5c090744c58b315f3ca58d7221'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:25.980322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1019/2020] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:25 2022] DELETE /identity/v3/users/2286dd5c090744c58b315f3ca58d7221 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:26.191530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:26.192949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:26.222415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:26.269272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7546d3-c65b-4378-948c-ea94cb0f4bbc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:26.333089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:26.333725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.334001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.334273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.336649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:26.353265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:26.355644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:26.364209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:26.437330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:26.439004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3808dc0-ee16-4cbb-801f-bcbccb2c1851 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:26.449841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13263399-1b5d-435b-ab37-74b79a2f1d5b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:26.452653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1002/2021] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:26.457051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:26.458184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.458609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.459217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] PATH_INFO: `/v3/projects/9ca92a4102a14b18aca1505629550567` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.460866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca92a4102a14b18aca1505629550567)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:26.462931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:26.515663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca92a4102a14b18aca1505629550567', 'request_id': 'req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:26.522189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca92a4102a14b18aca1505629550567', 'request_id': 'req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:26.531254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca92a4102a14b18aca1505629550567', 'request_id': 'req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:26.542832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] The token cache is being invalidate because project 9ca92a4102a14b18aca1505629550567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:26.543279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:26.544022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-6931acf3-0c4b-4cfa-8156-55bca6a3bed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:26.545837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1020/2022] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:26 2022] DELETE /identity/v3/projects/9ca92a4102a14b18aca1505629550567 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:26.550716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.551215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.551296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.575101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:26.577015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:26.671525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1003/2023] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:26.680348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.680684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.681099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.707438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:26.708664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:26.720912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1021/2024] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:26.721948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:26.733615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97163268-8c8a-472a-90e5-7faf50b6542e None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:26.738596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:26.739959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.739959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.740229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.740824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:26.741147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:26.742886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:26.759565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1004/2025] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:26.765436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:26.778532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f26c6-3f4a-4ff2-9f20-ad1d0d5a4226 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:26.792131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:26.792791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.793732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.795276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.796316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:26.799482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:26.840331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1022/2026] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:26 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:26.841787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:26.857310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d157c56-10de-4c0d-a8b2-6996e07235fe admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:26.882393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:26.990246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:26.991138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:26.991501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:26.991783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:26.992502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:26.994698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.025476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1005/2027] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:26 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:27.026776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.039515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ade9-1163-47dd-807e-c6f534078c5c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:27.044817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:27.045455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.045715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.046003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.046726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:27.048517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.059197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1023/2028] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:27.063474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.073450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ea0ca-8e74-454c-963f-03ff5dc5990c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:27.079060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:27.079752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.080023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.080296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.080964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:27.082972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ba00-e49e-4eb2-8c17-1133d04a377e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.094119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1006/2029] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:27.099002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.111288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68e9d-c5b6-490d-ae72-ac8146f81e9f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:27.117454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:27.118248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.118624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.119010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] PATH_INFO: `/v3/projects/04692053fb8f49aba52a752760ba6c4c/users/2744339991814428a9eeb9249d40b615/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.137816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=04692053fb8f49aba52a752760ba6c4c, user_id=2744339991814428a9eeb9249d40b615, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:27.140860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.157296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1024/2030] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:27 2022] PUT /identity/v3/projects/04692053fb8f49aba52a752760ba6c4c/users/2744339991814428a9eeb9249d40b615/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:27.169734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.170047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.170375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.205318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] MFA Rules not processed for user `2744339991814428a9eeb9249d40b615`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:27.206742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:27.293219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.295077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:27.309850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1007/2031] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:27.323747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.325441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:27.336684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:27.384482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aadd2-95ec-4950-bf56-75f6baca08ba admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:27.390299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:27.390989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.391299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.391596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] PATH_INFO: `/v3/users/6becd0b993d445e09739f3626e514a18` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.392760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6becd0b993d445e09739f3626e514a18)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:27.394709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.395544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242ee5a-bc8a-4d5a-a565-06c57792d7a8 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:27.403148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:27.403822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.404102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.404375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.436800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:27.442741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012a5e7-5a1f-42dd-ac82-fce312a675cc service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:27.464206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1008/2032] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:27.503842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6becd0b993d445e09739f3626e514a18'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:27.504834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6becd0b993d445e09739f3626e514a18'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:27.505468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6becd0b993d445e09739f3626e514a18'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:27.525440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6becd0b993d445e09739f3626e514a18'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:27.540965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6becd0b993d445e09739f3626e514a18'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:27.570505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1025/2033] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:27 2022] DELETE /identity/v3/users/6becd0b993d445e09739f3626e514a18 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:27.572618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:27.573074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:27.573370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:27.630946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:27.633357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:27.701123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:27.780052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1009/2034] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:27.911212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:27.912974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:28.091790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc8a5-63cd-47a6-8e8e-14988bebe452 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:28.103695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:28.104723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:28.106155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:28.106576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:28.127055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:28.129410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:28.145275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1026/2035] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:28.932687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:28.935982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:28.949530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e82b24-bb07-40d9-9dc7-b8b72c68399a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:28.957417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:28.958286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:28.958650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:28.959296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] PATH_INFO: `/v3/projects/01f44dc6d68f49e4ad377d1f39b48821` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:28.960832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f44dc6d68f49e4ad377d1f39b48821)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:28.962793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:29.116323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f44dc6d68f49e4ad377d1f39b48821', 'request_id': 'req-9c9e6701-68a6-4179-a3e1-be829296abb6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.129295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f44dc6d68f49e4ad377d1f39b48821', 'request_id': 'req-9c9e6701-68a6-4179-a3e1-be829296abb6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.146095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f44dc6d68f49e4ad377d1f39b48821', 'request_id': 'req-9c9e6701-68a6-4179-a3e1-be829296abb6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.172372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] The token cache is being invalidate because project 01f44dc6d68f49e4ad377d1f39b48821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:29.172838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.173507 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.179609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:29.186844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1010/2036] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:28 2022] DELETE /identity/v3/projects/01f44dc6d68f49e4ad377d1f39b48821 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:29.192003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661ec47-92a5-4bc9-9178-90fc1e95c1c1 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:29.289672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:29.299643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:29.300665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:29.302439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:29.302932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] PATH_INFO: `/v3/users/d24f4592da154f6ea57ad406d1f58f0a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:29.309132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24f4592da154f6ea57ad406d1f58f0a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:29.312140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:29.392280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24f4592da154f6ea57ad406d1f58f0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.393207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24f4592da154f6ea57ad406d1f58f0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.394300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24f4592da154f6ea57ad406d1f58f0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.404321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24f4592da154f6ea57ad406d1f58f0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.412618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24f4592da154f6ea57ad406d1f58f0a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.438705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1027/2037] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:29 2022] DELETE /identity/v3/users/d24f4592da154f6ea57ad406d1f58f0a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:29.731063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:29.732864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:29.747669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6701-68a6-4179-a3e1-be829296abb6 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:29.824820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:29.825682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:29.826012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:29.826521 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] PATH_INFO: `/v3/projects/49ce36f6401543cbaf7b1f0cef7c2976` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:29.827677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ce36f6401543cbaf7b1f0cef7c2976)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:29.830263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:29.937235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ce36f6401543cbaf7b1f0cef7c2976', 'request_id': 'req-2b2fd673-d91b-4d79-a877-052c39956668'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.939359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:29.946611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ce36f6401543cbaf7b1f0cef7c2976', 'request_id': 'req-2b2fd673-d91b-4d79-a877-052c39956668'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.953849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ce36f6401543cbaf7b1f0cef7c2976', 'request_id': 'req-2b2fd673-d91b-4d79-a877-052c39956668'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.994409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] The token cache is being invalidate because project 49ce36f6401543cbaf7b1f0cef7c2976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:29.994915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.995888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:29.997807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1011/2038] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:29 2022] DELETE /identity/v3/projects/49ce36f6401543cbaf7b1f0cef7c2976 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:30.002083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:30.003852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:30.030866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b350fe-75f9-4c2e-8867-5b703ddddd0e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:30.116680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:30.117695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:30.118168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:30.118620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] PATH_INFO: `/v3/users/c5b48837549e4fa19e98211a338cce26` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:30.120107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b48837549e4fa19e98211a338cce26)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:30.123942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:30.195223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b48837549e4fa19e98211a338cce26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.196594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b48837549e4fa19e98211a338cce26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.196800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b48837549e4fa19e98211a338cce26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.210449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b48837549e4fa19e98211a338cce26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.220131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bf2123c4-09f3-4410-81da-7d8271d328a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b48837549e4fa19e98211a338cce26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.229548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:30.244923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1028/2039] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:30 2022] DELETE /identity/v3/users/c5b48837549e4fa19e98211a338cce26 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:30.640762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:30.642391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:30.657237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd673-d91b-4d79-a877-052c39956668 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:30.718444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:30.719116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:30.719493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:30.719768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] PATH_INFO: `/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:30.720944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a1b2ce4575409f8f866f3bafa58a26)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:30.722901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:30.777850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a1b2ce4575409f8f866f3bafa58a26', 'request_id': 'req-258ab32e-e6a3-42df-8160-7de9a67641c0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.785140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a1b2ce4575409f8f866f3bafa58a26', 'request_id': 'req-258ab32e-e6a3-42df-8160-7de9a67641c0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.792503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a1b2ce4575409f8f866f3bafa58a26', 'request_id': 'req-258ab32e-e6a3-42df-8160-7de9a67641c0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.810933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] The token cache is being invalidate because project f6a1b2ce4575409f8f866f3bafa58a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:30.811305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.811927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-258ab32e-e6a3-42df-8160-7de9a67641c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:30.813577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1012/2040] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:30 2022] DELETE /identity/v3/projects/f6a1b2ce4575409f8f866f3bafa58a26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:30.819654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:30.819946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:30.820221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:30.840102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:30.841325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:30.903913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1029/2041] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:30.912875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:30.913162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:30.913442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:30.935021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:30.937131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:30.947438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1013/2042] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:30.951800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:30.961784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26470-39c6-4e1f-8230-07a31db9785b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:30.966668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:30.967323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:30.967574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:30.967842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:30.968501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:30.968801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:30.970523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:30.983268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1030/2043] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:30.987523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:30.997660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b258cc-c9f6-40aa-a139-9a38feb7a286 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.002738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.003387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.003661 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.003931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.004572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.006530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.034021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.036012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.038909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1014/2044] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:30 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:31.043039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.049210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8d0e-82ae-4197-ab32-57a337194cca admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.095706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:31.121502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df924c-ecc2-4435-bb1b-969b26669e8a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.128339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.128973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.129250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.129525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.130310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.132453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.144725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.145407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.145670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.145940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] PATH_INFO: `/v3/users/418e3ef929b244728af32dbfdf06a8ea` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.148511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=418e3ef929b244728af32dbfdf06a8ea)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.151511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.163327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1015/2045] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:31.167509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.178693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3eb8-aaa7-45d2-b49c-977689862ee8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.186862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.188084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.188775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.189332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.191315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.193520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.207421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1016/2046] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:31.210979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.222109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e402-b26a-4ed1-9980-ed4971243b7c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.227853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418e3ef929b244728af32dbfdf06a8ea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.228374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.228616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418e3ef929b244728af32dbfdf06a8ea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.229081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.229235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418e3ef929b244728af32dbfdf06a8ea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.229699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.229973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.230626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.232398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.244489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418e3ef929b244728af32dbfdf06a8ea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.256460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-47200b88-0545-4b8b-99ab-c22c024afe9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418e3ef929b244728af32dbfdf06a8ea'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.258886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1017/2047] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:31.259807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.263976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.279996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:31.287843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08916f64-e616-4d48-a82b-83734cf1f25d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.295909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.297830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.298354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.298962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] PATH_INFO: `/v3/projects/1c4f1f587b534ee1a1d66e364a4f94e1/users/f69bc41322a24d0e9b0d1e234f9fb84e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.302624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1031/2048] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:31 2022] DELETE /identity/v3/users/418e3ef929b244728af32dbfdf06a8ea => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:31.307046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.307629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.308288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.324658 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4f1f587b534ee1a1d66e364a4f94e1, user_id=f69bc41322a24d0e9b0d1e234f9fb84e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.327820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f733575-b502-4fa5-9942-0e1539cb8f1c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.330735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:31.332218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.346477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1018/2049] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:31 2022] PUT /identity/v3/projects/1c4f1f587b534ee1a1d66e364a4f94e1/users/f69bc41322a24d0e9b0d1e234f9fb84e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:31.359657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.360060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.360427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.398294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] MFA Rules not processed for user `f69bc41322a24d0e9b0d1e234f9fb84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:31.399684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.407778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1032/2050] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:31.418649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.420289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.474939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1019/2051] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:31.479413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.492101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3688c-f435-4dc2-879a-fc5bc1c5346f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.542659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.543214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.543623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.543903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.547788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48155e-a0b7-47e6-a86a-b24b81f475c6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.553127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.553410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.553805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.554227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.554511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.555149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.555588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.557111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.566372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1033/2052] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:31.584833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:31.602844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1020/2053] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:31.606822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.621743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e520e2-262d-48da-81bd-75a15cb05fd5 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.694824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:31.703814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.705187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.705490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.705774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.706590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.709374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.746161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1034/2054] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:31.750044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.766442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa3e0-064f-4231-ad06-f43642fc275c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.772780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.773617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.783713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.784138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.785121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.786808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.800425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1021/2055] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:31.804385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.819686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415b01-ab20-47df-8544-4400cd075fc3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.825652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.826975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.827340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.827955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.828843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.831018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.831420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.832834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.846788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1035/2056] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:31.852338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:31.865787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563caf5a-8ef6-4303-819d-4e20935af53e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.866602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcf278-40e5-4994-88bb-02d2510b4b2b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:31.880034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.880655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:31.880798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.880966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.881227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] PATH_INFO: `/v3/users/01a825a17d8044caad2a49d668c6d7f7` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.881327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.881593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.881867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] PATH_INFO: `/v3/projects/58ead84cd6e74c938a5a6a71cb4bfcf0/users/393340d1019d4f02a13589dc6a6fc2ba/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.882564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a825a17d8044caad2a49d668c6d7f7)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.885071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.900228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ead84cd6e74c938a5a6a71cb4bfcf0, user_id=393340d1019d4f02a13589dc6a6fc2ba, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:31.903580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f3a3f-43ce-415f-bb1c-53b3d6fd5f84 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:31.920025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1036/2057] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:31 2022] PUT /identity/v3/projects/58ead84cd6e74c938a5a6a71cb4bfcf0/users/393340d1019d4f02a13589dc6a6fc2ba/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:31.930817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.931102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.931502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:31.945626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a825a17d8044caad2a49d668c6d7f7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.955471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a825a17d8044caad2a49d668c6d7f7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.962172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] MFA Rules not processed for user `393340d1019d4f02a13589dc6a6fc2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:31.963495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:31.964720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a825a17d8044caad2a49d668c6d7f7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.965525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a825a17d8044caad2a49d668c6d7f7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.983578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a0adee90-3ec1-41d9-9432-81adb476e83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a825a17d8044caad2a49d668c6d7f7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:31.994122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1022/2058] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:31 2022] DELETE /identity/v3/users/01a825a17d8044caad2a49d668c6d7f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:31.998523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:31.999058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:31.999403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.019694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:32.020939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.047723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1037/2059] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:32.052648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.054251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.088244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1023/2060] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:32.091651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.092722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.105013 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29f43a-3e22-42f6-b1fb-f6af63ecec9d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.109761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.110374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.110655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.110923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.111572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.113604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.125421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177db34-177f-402e-a0f8-f815cbdd6182 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.130024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.130671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.130944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.131240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] PATH_INFO: `/v3/projects/de2b1ce86c774c26b24283fcd2a8f000` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.132397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2b1ce86c774c26b24283fcd2a8f000)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.134327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.146762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1024/2061] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:32 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:32.146762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.146762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.183804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:32.187922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2b1ce86c774c26b24283fcd2a8f000', 'request_id': 'req-d764498e-7668-44e6-b48e-7300fd32070f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.189861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:32.195971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2b1ce86c774c26b24283fcd2a8f000', 'request_id': 'req-d764498e-7668-44e6-b48e-7300fd32070f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.204993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2b1ce86c774c26b24283fcd2a8f000', 'request_id': 'req-d764498e-7668-44e6-b48e-7300fd32070f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.206890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d476e-dc44-4225-978a-8b4dcb36848e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.216127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] The token cache is being invalidate because project de2b1ce86c774c26b24283fcd2a8f000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:32.216412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.217275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.219609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1038/2062] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:32 2022] DELETE /identity/v3/projects/de2b1ce86c774c26b24283fcd2a8f000 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:32.220597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.222292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.263748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.264374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.264705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.264984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.266791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.289657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764498e-7668-44e6-b48e-7300fd32070f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.295002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.295658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.295958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.296196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.297138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.299335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.324826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1039/2063] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:32 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:32.325813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.327609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.337470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.339063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.343762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b161-70e0-462d-a97c-6471f94d5289 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.348585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.349003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1025/2064] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:32.349357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.349726 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.349832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.350069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] PATH_INFO: `/v3/users/92c42fdaa2d847a29525625aa80c3650` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.351311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c42fdaa2d847a29525625aa80c3650)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.353301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.362351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00139-a798-4de2-bbc1-a8963b5be6a3 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.370491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.371130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.371462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.371727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.372571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.374681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.390012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1026/2065] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:32.393026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.404078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85399df0-49ff-4244-b05b-989a5dbe1f9c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.409265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.410037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.410393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.410864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] PATH_INFO: `/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37/users/421c577f77dd4154b843a414229db490/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.426613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c42fdaa2d847a29525625aa80c3650'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.427425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c42fdaa2d847a29525625aa80c3650'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.428414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5221e0b573ca4dac8aaa1807c5a7ba37, user_id=421c577f77dd4154b843a414229db490, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.428707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c42fdaa2d847a29525625aa80c3650'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.431743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.439849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c42fdaa2d847a29525625aa80c3650'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.450681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c42fdaa2d847a29525625aa80c3650'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:32.455371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1027/2066] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:32 2022] PUT /identity/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37/users/421c577f77dd4154b843a414229db490/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:32.460366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.465142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.504293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1040/2067] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:32 2022] DELETE /identity/v3/users/92c42fdaa2d847a29525625aa80c3650 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:32.564782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a76b-3f6e-48ff-a63f-c944f0c8ffcb admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.579789 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:32.641494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.642247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.642511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.642786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.643571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.645511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638aecb-e9c5-4aab-9371-3cd97d5e51dc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.658862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1028/2068] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:32.662979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.674320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff757338-825b-4084-8901-ec2a7f360a39 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.680143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.680929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.681305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.681643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] PATH_INFO: `/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37/users/421c577f77dd4154b843a414229db490/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.683840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5221e0b573ca4dac8aaa1807c5a7ba37, user_id=421c577f77dd4154b843a414229db490, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.686730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:32.699223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1041/2069] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:32 2022] PUT /identity/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37/users/421c577f77dd4154b843a414229db490/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:32.710700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.710980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.711280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.742977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] MFA Rules not processed for user `421c577f77dd4154b843a414229db490`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:32.744763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.846969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.848975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.880582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:32.899116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1029/2070] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:32.920210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:32.921926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:32.981968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d43c6-a5ab-4840-b81d-e12221eb04b0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:32.987525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:32.988263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:32.988603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:32.988941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] PATH_INFO: `/v3/projects/6a46ac04c57a41eeaf4e8da9baf35051` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:32.990562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a46ac04c57a41eeaf4e8da9baf35051)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:32.992794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.030476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137810c-ed27-48dc-b991-5b8cd770c113 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.036572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.037200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.037518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.037784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.050626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.052284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.070338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a46ac04c57a41eeaf4e8da9baf35051', 'request_id': 'req-fad7d83d-296d-479c-a3de-80eef2056985'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.078676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1030/2071] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:33.079717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.082686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.102243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a46ac04c57a41eeaf4e8da9baf35051', 'request_id': 'req-fad7d83d-296d-479c-a3de-80eef2056985'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.121130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277887-48c3-4273-b212-291a32671a82 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.121335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a46ac04c57a41eeaf4e8da9baf35051', 'request_id': 'req-fad7d83d-296d-479c-a3de-80eef2056985'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.148448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] The token cache is being invalidate because project 6a46ac04c57a41eeaf4e8da9baf35051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:33.148814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.150594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.153368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1042/2072] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:32 2022] DELETE /identity/v3/projects/6a46ac04c57a41eeaf4e8da9baf35051 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:33.154656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.156699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.184925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:33.205561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.206314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.206594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.206860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] PATH_INFO: `/v3/projects/9cbb2d08836140b3993454b7cdd71fcd` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.208008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbb2d08836140b3993454b7cdd71fcd)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.210042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.220607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d83d-296d-479c-a3de-80eef2056985 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.224624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.225313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.225723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.226014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.228183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.263886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbb2d08836140b3993454b7cdd71fcd', 'request_id': 'req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.271532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbb2d08836140b3993454b7cdd71fcd', 'request_id': 'req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.278471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbb2d08836140b3993454b7cdd71fcd', 'request_id': 'req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.292560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] The token cache is being invalidate because project 9cbb2d08836140b3993454b7cdd71fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:33.292857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.293489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.295325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1031/2073] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:33 2022] DELETE /identity/v3/projects/9cbb2d08836140b3993454b7cdd71fcd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:33.295814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.297165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.299234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.300941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e54a-2f30-470c-8d2d-2719bfab177d service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.311222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1043/2074] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:33.320870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654e52-ef10-4021-9c72-93be85f7a664 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.321115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654e52-ef10-4021-9c72-93be85f7a664 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.321497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654e52-ef10-4021-9c72-93be85f7a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.330757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:33.346141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ed654e52-ef10-4021-9c72-93be85f7a664 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:33.347492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ed654e52-ef10-4021-9c72-93be85f7a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.371492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205dfcc-1741-4ec5-9fa6-bb8ba25027ae admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.377598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.378415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.378855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.379265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] PATH_INFO: `/v3/users/8f2804fcd30e429494dc1199ad732178` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.380673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2804fcd30e429494dc1199ad732178)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.383085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.440701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1044/2075] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:33.444473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.445308 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.446573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.453578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2804fcd30e429494dc1199ad732178'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.471054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2804fcd30e429494dc1199ad732178'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.478587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:33.480139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.481821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2804fcd30e429494dc1199ad732178'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.482623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2804fcd30e429494dc1199ad732178'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.495493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:33.502467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1045/2076] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:33.507023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2804fcd30e429494dc1199ad732178'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:33.507611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.520038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759b35-9e6b-40cf-a314-311c1c21d381 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.527367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.528284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.528712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.529127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.530097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:33.530572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.532386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.550156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1032/2077] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:33 2022] DELETE /identity/v3/users/8f2804fcd30e429494dc1199ad732178 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:33.555742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1046/2078] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:33.561133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.663422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41195d-b63a-45c5-8a64-4c0e585d5e98 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.671229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.671229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.671229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.671813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.672592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.675056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.706180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1033/2079] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:33 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:33.711964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.726236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02d26-ca9b-4f7a-bf22-d3860fb5acfd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.808579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.809410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.810634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.811009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.813689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.816119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.859424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1047/2080] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:33 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:33.862234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.875834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001fa26-113b-4afe-b0b9-e158b2c3c451 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.881075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.881895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.882236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.882532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.883261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.885020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.901672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1034/2081] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:33.906017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.917461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eb9c8-3686-4191-9ae4-adca5537d996 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.922762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.923406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.923819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.924098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:33.924888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:33.926482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:33.939222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1048/2082] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:33.945691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.974187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a1e13-62e8-465b-ba6e-1a824938bf8f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:33.982723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:33.984754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:33.992914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:33.995643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:33.997758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:33.997955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] PATH_INFO: `/v3/projects/9f83756616b245058f98ed0007b2a5cf/users/1f73e606196e45f5afbfa3023f6edf93/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.026155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a21bf-6260-42ad-be69-6f46cbe55819 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.049597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.052844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.053576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.054801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] PATH_INFO: `/v3/projects/bf401bde3ab64640858cd292b2171f25` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.056394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf401bde3ab64640858cd292b2171f25)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.058351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.062587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f83756616b245058f98ed0007b2a5cf, user_id=1f73e606196e45f5afbfa3023f6edf93, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.065870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4121cf7-30ab-488b-9def-22b03b5958ed admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.089145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1035/2083] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:33 2022] PUT /identity/v3/projects/9f83756616b245058f98ed0007b2a5cf/users/1f73e606196e45f5afbfa3023f6edf93/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:34.100415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.100726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.101122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.155449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf401bde3ab64640858cd292b2171f25', 'request_id': 'req-0ddbf229-1108-4bdf-9b58-1b764915d08f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:34.169610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf401bde3ab64640858cd292b2171f25', 'request_id': 'req-0ddbf229-1108-4bdf-9b58-1b764915d08f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:34.174686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:34.175422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] MFA Rules not processed for user `1f73e606196e45f5afbfa3023f6edf93`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:34.177640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:34.191642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf401bde3ab64640858cd292b2171f25', 'request_id': 'req-0ddbf229-1108-4bdf-9b58-1b764915d08f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:34.211916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] The token cache is being invalidate because project bf401bde3ab64640858cd292b2171f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:34.212212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:34.216767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0ddbf229-1108-4bdf-9b58-1b764915d08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:34.218783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1049/2084] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:33 2022] DELETE /identity/v3/projects/bf401bde3ab64640858cd292b2171f25 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:34.224840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aaee6-cbfd-4a4f-9300-bc2404335e32 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.225306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aaee6-cbfd-4a4f-9300-bc2404335e32 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.225759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aaee6-cbfd-4a4f-9300-bc2404335e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.269888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c44aaee6-cbfd-4a4f-9300-bc2404335e32 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:34.271098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c44aaee6-cbfd-4a4f-9300-bc2404335e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:34.362257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1036/2085] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:34.364294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.365311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1050/2086] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:34.374893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.375108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:34.375226 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.375412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.415146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2455e8e-3c88-4aa7-a10c-7025876219e6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.418149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:34.419477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:34.440422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.442123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.442692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.442978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.443988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.444691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1051/2087] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:34.455440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.455801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.478797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc86e7-d8c6-499c-ae93-c4ab977f1755 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.504006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.520565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.521255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.526160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1037/2088] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:34.529053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.530030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.541518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:34.543356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.549460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.557243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:34.599360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1052/2089] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:34.602021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.660496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e37841-12da-46d1-ae43-30fc2ee01447 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.680985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b80c82-cf1b-438c-8a76-55bdda1bf4e2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.688308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.689298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.690829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.690829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.690829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.693872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.735078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1038/2090] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:34.742981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.767067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cea37-53b5-4267-80f4-8094e9d7a4a3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.784801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.788147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.788523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.788945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.789772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.794375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.813064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1039/2091] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:34.831813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.844579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.845399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.845630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.845901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.846761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.850535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.880730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedf5b7-d88d-41db-b5c8-226912e3bc5d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:34.893011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1053/2092] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:34.899110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:34.901237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:34.905478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:34.906425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:34.908504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] PATH_INFO: `/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8/users/a5a507cfc06b46b98af0da41389ec6f8/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:34.953100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f8fc97e5a3400283e2c311e9e761a8, user_id=a5a507cfc06b46b98af0da41389ec6f8, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:34.960029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:34.996474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1040/2093] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:34 2022] PUT /identity/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8/users/a5a507cfc06b46b98af0da41389ec6f8/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:35.001553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.027608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:35.052208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b1022-eec3-4b2b-8e1a-b0409fa94ef9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.144642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.145588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.146068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.146513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.147383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.149752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.187704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1054/2094] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:34 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:35.196751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.224463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c18c-8eb0-44fe-bbb6-371468cf3745 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.228750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55114a69-e37a-4932-955e-cb8c2764872e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.235537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.236367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.236652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.237634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.239358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.243242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.243790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.243902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.244142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.244572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.245273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.247603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.276771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1041/2095] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:35.281005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.292732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0987c5-7cd4-4651-a50b-3ea1d11338f3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.303654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.304785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.304785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.305183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1055/2096] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:35.305488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] PATH_INFO: `/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8/users/a5a507cfc06b46b98af0da41389ec6f8/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.309430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.311410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f8fc97e5a3400283e2c311e9e761a8, user_id=a5a507cfc06b46b98af0da41389ec6f8, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.314533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.328310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9f45c-b948-4a3f-baee-da82f445109e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.335003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.335842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.336486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.336486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.337363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.340480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09bed9-df74-40d8-a7a0-fff5d16ff440 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.361723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1056/2098] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:35.374677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1042/2098] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:35 2022] PUT /identity/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8/users/a5a507cfc06b46b98af0da41389ec6f8/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:35.376251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.376705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.376944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.377233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.421422 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] MFA Rules not processed for user `a5a507cfc06b46b98af0da41389ec6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:35.423669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:35.479957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:35.511223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d262b35-bdbd-445b-9a73-063fff0423c8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.524710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.525999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.526766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.527123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] PATH_INFO: `/v3/projects/d8e38edd6fd34552a1cbcccb344d2277/users/14089e2e603b411397870452d4568024/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.540129 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1057/2099] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:35.552512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.553948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:35.558504 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e38edd6fd34552a1cbcccb344d2277, user_id=14089e2e603b411397870452d4568024, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.569707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ce8b-ff98-4f0a-a377-070d930469a3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.607243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1043/2100] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:35 2022] PUT /identity/v3/projects/d8e38edd6fd34552a1cbcccb344d2277/users/14089e2e603b411397870452d4568024/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:35.610519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.610519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.610771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.661124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] MFA Rules not processed for user `14089e2e603b411397870452d4568024`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:35.662916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:35.671420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ac94-4703-436a-8684-debd7d483c4e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.679776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:35.787309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.788322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.788671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.789194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.803965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1044/2101] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:35.808425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:35.895263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.897165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.900583 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269452f2-b5ca-4bb2-ad21-e9613c780ebd None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:35.909554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:35.910505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:35.910992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:35.911417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:35.912027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1058/2102] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:35.913289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:35.917126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:35.989429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1045/2103] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:35 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:35.989543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.002209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589feb7b-9c72-4ce4-88c9-17084541b734 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.058156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.066114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:36.128878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.129506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.129874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.130148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.131193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.136272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.164441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:36.191154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1059/2104] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:35 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:36.192105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.200049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba39e-53fc-4bc8-95b7-2634fcec1278 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.205250 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c2d4-34b7-4e9d-a51a-b408f03e739a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.206846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.207944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.208379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.210132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.212658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.220499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.220958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.221302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.222588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.224558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.243165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1060/2105] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:36.244472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.264543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59229d83-7ed0-4989-8199-d04ce3cacbd5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.272586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.272586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.273629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.273982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.275348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.277900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.296622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1061/2106] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:36.301815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.303025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.305216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8af0b-97c0-4f8c-88f1-8b7c276abe7f service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.319787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa993c-3610-4a8d-820f-f798a90a1917 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.320438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1046/2107] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:36.339441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.340325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.340761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.341043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] PATH_INFO: `/v3/projects/f38d35c53fd649de92ecc32216abb405/users/12c59c96a0be47b594ee9f619a45b3b7/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.373901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38d35c53fd649de92ecc32216abb405, user_id=12c59c96a0be47b594ee9f619a45b3b7, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.377537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.398451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1062/2108] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:36 2022] PUT /identity/v3/projects/f38d35c53fd649de92ecc32216abb405/users/12c59c96a0be47b594ee9f619a45b3b7/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:36.409567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.410433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.411203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.443880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] MFA Rules not processed for user `12c59c96a0be47b594ee9f619a45b3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:36.445124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:36.536754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1047/2109] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:36.538161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.544657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:36.639916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccdae3-56e7-4a08-9c75-87050213d3f7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.645207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.646126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.646672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.647070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.648377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.650409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.689865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1063/2110] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:36 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:36.693731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.711938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4a3e7-9a2d-429e-8d4f-5fc3856f6748 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.785119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.786393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.786393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.786393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.787283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.789445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.811250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1048/2111] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:36 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:36.815038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.825605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800604-7129-4992-9354-3d2ca774ca66 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.830395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.830993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.831405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.831670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.832342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.833962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.844928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1064/2112] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:36.849389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.859527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df67a-7f2e-4fe5-8a82-48657d8b7b03 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.864916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.865860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.865860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.866115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] PATH_INFO: `/v3/projects/36ff56a841ee4769a202003e30f96ba4/users/bac63b2051a345e1b3e8f334f4822fcb/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.878982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:36.882358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ff56a841ee4769a202003e30f96ba4, user_id=bac63b2051a345e1b3e8f334f4822fcb, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.885720 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.902688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1049/2113] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:36 2022] PUT /identity/v3/projects/36ff56a841ee4769a202003e30f96ba4/users/bac63b2051a345e1b3e8f334f4822fcb/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:36.906839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:36.916935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a01c8-2919-42f3-b6de-49c9aee557da admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:36.974949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:36.975513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:36.975797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:36.976074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:36.976733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:36.978387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0f44b-54be-434d-852e-056684f38421 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:36.994182 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1065/2114] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:36.998487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:37.010622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6154bb-0ce2-4d42-b0c4-7d64df06b690 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:37.019911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:37.020812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.021110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.021439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] PATH_INFO: `/v3/projects/36ff56a841ee4769a202003e30f96ba4/users/bac63b2051a345e1b3e8f334f4822fcb/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.023923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ff56a841ee4769a202003e30f96ba4, user_id=bac63b2051a345e1b3e8f334f4822fcb, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:37.027571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:37.040382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1050/2115] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:36 2022] PUT /identity/v3/projects/36ff56a841ee4769a202003e30f96ba4/users/bac63b2051a345e1b3e8f334f4822fcb/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:37.050103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.050400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.050653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.081637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] MFA Rules not processed for user `bac63b2051a345e1b3e8f334f4822fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:37.082968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:37.099598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:37.101960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:37.162638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:37.172206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1066/2116] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:37.184664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:37.186500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64f6a5-d2c5-4d38-99b1-f661a91271a3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:37.194752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:37.195632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.195988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.196328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] PATH_INFO: `/v3/users/f69bc41322a24d0e9b0d1e234f9fb84e` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.197744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69bc41322a24d0e9b0d1e234f9fb84e)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:37.200049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:37.250263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e0b0-35b6-4b47-bacf-c358c735524a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:37.254229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:37.254855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.255131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.255437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.257638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69bc41322a24d0e9b0d1e234f9fb84e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:37.271783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69bc41322a24d0e9b0d1e234f9fb84e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:37.291772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69bc41322a24d0e9b0d1e234f9fb84e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:37.292650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69bc41322a24d0e9b0d1e234f9fb84e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:37.319941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-86c666b1-b9d7-44a9-a206-d2494bccf57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69bc41322a24d0e9b0d1e234f9fb84e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:37.333040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1051/2117] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:37 2022] DELETE /identity/v3/users/f69bc41322a24d0e9b0d1e234f9fb84e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:37.345127 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.345414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.345687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.353860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:37.355674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:37.384231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1067/2118] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:37.400822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:37.402071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:37.528739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:37.555944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1052/2119] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:37.566034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:37.568112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:37.725947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bf7a-fd97-4f7a-b865-e67322cab29a service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:37.932001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:37.934570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:37.936197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:37.936878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:37.975434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:37.981617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:38.033858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1068/2120] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:38.435424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:38.436919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:38.449772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c81395-3580-4b04-a298-1a07afb05eb0 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:38.455047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:38.455682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:38.455938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:38.456174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] PATH_INFO: `/v3/projects/1c4f1f587b534ee1a1d66e364a4f94e1` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:38.457320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4f1f587b534ee1a1d66e364a4f94e1)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:38.459378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:38.511993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4f1f587b534ee1a1d66e364a4f94e1', 'request_id': 'req-5cac0113-c53e-415f-a444-d24c9564e0e5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.518212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4f1f587b534ee1a1d66e364a4f94e1', 'request_id': 'req-5cac0113-c53e-415f-a444-d24c9564e0e5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.523784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4f1f587b534ee1a1d66e364a4f94e1', 'request_id': 'req-5cac0113-c53e-415f-a444-d24c9564e0e5'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.539660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] The token cache is being invalidate because project 1c4f1f587b534ee1a1d66e364a4f94e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:38.540020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.540676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.542500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1053/2121] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:38 2022] DELETE /identity/v3/projects/1c4f1f587b534ee1a1d66e364a4f94e1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:38.546479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:38.557343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363681-d29c-43e3-9a8f-e6ad60e2d982 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:38.571376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:38.656023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:38.656784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:38.657061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:38.657818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] PATH_INFO: `/v3/users/393340d1019d4f02a13589dc6a6fc2ba` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:38.658672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393340d1019d4f02a13589dc6a6fc2ba)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:38.660840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:38.744404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393340d1019d4f02a13589dc6a6fc2ba'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.745277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393340d1019d4f02a13589dc6a6fc2ba'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.745982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393340d1019d4f02a13589dc6a6fc2ba'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.760755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393340d1019d4f02a13589dc6a6fc2ba'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.770963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393340d1019d4f02a13589dc6a6fc2ba'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:38.811152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1069/2122] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:38 2022] DELETE /identity/v3/users/393340d1019d4f02a13589dc6a6fc2ba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:39.362896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:39.366437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:39.383366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac0113-c53e-415f-a444-d24c9564e0e5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:39.497282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:39.499064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:39.499703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:39.500259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] PATH_INFO: `/v3/projects/58ead84cd6e74c938a5a6a71cb4bfcf0` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:39.502469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ead84cd6e74c938a5a6a71cb4bfcf0)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:39.505791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:39.551773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:39.553774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:39.594398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ead84cd6e74c938a5a6a71cb4bfcf0', 'request_id': 'req-caf20ef4-14b9-43d9-a39b-3fac60e92e39'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.604270 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ead84cd6e74c938a5a6a71cb4bfcf0', 'request_id': 'req-caf20ef4-14b9-43d9-a39b-3fac60e92e39'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.617573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ead84cd6e74c938a5a6a71cb4bfcf0', 'request_id': 'req-caf20ef4-14b9-43d9-a39b-3fac60e92e39'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.638073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] The token cache is being invalidate because project 58ead84cd6e74c938a5a6a71cb4bfcf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:39.638388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.639147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.641129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1054/2123] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:39 2022] DELETE /identity/v3/projects/58ead84cd6e74c938a5a6a71cb4bfcf0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:39.644849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:39.646633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:39.660750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becb242-aebb-4405-b56b-0c12503b8603 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:39.682412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:39.754811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:39.761313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20ef4-14b9-43d9-a39b-3fac60e92e39 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:39.763506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:39.764487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:39.764798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:39.765390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:39.768321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:39.768598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:39.769345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:39.769683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:39.770026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] PATH_INFO: `/v3/users/421c577f77dd4154b843a414229db490` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:39.771418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421c577f77dd4154b843a414229db490)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:39.773456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:39.825581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421c577f77dd4154b843a414229db490'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.834018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:39.834160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421c577f77dd4154b843a414229db490'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.835500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:39.840994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421c577f77dd4154b843a414229db490'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.841641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421c577f77dd4154b843a414229db490'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.844597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1070/2124] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:39.853556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e496f312-9178-4662-9bc0-a4817be0a700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421c577f77dd4154b843a414229db490'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:39.859707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1055/2125] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:39 2022] DELETE /identity/v3/users/421c577f77dd4154b843a414229db490 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:40.247803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.266540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171f6f4-71fd-4f55-8237-3f3effd365d8 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.363086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.363770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.364053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.364327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] PATH_INFO: `/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.365469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5221e0b573ca4dac8aaa1807c5a7ba37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.367455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.423145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5221e0b573ca4dac8aaa1807c5a7ba37', 'request_id': 'req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.430123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5221e0b573ca4dac8aaa1807c5a7ba37', 'request_id': 'req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.441697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5221e0b573ca4dac8aaa1807c5a7ba37', 'request_id': 'req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.458996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] The token cache is being invalidate because project 5221e0b573ca4dac8aaa1807c5a7ba37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:40.459435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.460234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.462151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1071/2126] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:40 2022] DELETE /identity/v3/projects/5221e0b573ca4dac8aaa1807c5a7ba37 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:40.468252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161666-1b89-41d4-9c67-f9ce236fc99a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.468839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161666-1b89-41d4-9c67-f9ce236fc99a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.469177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161666-1b89-41d4-9c67-f9ce236fc99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.499694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a8161666-1b89-41d4-9c67-f9ce236fc99a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:40.499694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a8161666-1b89-41d4-9c67-f9ce236fc99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.566245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.571459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1056/2127] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:40.571603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.575987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.576722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.577651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.597978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:40.599267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.605561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:40.608355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1057/2128] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:40.612682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.629491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781cb89-1170-4f46-92ea-4ea9e8e05369 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.634544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.635168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.635485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.635755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.636540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:40.636709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.638321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.646022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab6dc-edd8-4a14-8db4-f366d22e6c0e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.652444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.652611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1058/2129] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:40.655374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.655468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.655553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.655553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.656659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.656805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.671212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd5efa-f9d4-4510-ba8f-3d33097823bc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.675879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.676585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.676863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.677134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] PATH_INFO: `/v3/users/1f73e606196e45f5afbfa3023f6edf93` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.678268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f73e606196e45f5afbfa3023f6edf93)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.680283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.685144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:40.728463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.730339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.736156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f73e606196e45f5afbfa3023f6edf93'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.746249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f73e606196e45f5afbfa3023f6edf93'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.747278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1072/2130] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:40.757418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f73e606196e45f5afbfa3023f6edf93'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.758221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f73e606196e45f5afbfa3023f6edf93'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.758358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.785401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ee62-a21d-4281-bac0-fed23e558e18 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.795220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-bd13e712-c494-4573-8b22-5357867f02fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f73e606196e45f5afbfa3023f6edf93'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:40.797239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.797875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.798159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.798433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.799075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.801041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.803636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1059/2131] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:40 2022] DELETE /identity/v3/users/1f73e606196e45f5afbfa3023f6edf93 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:40.808383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.810483 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.811439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.840061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1073/2132] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:40 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:40.844527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.846761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.856595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:40.858733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.941021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1060/2133] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:40.952241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:40.953917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:40.966738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d8d36-dcc4-456c-b787-b284c994d87a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:40.971510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:40.972253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:40.972600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:40.972933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:40.973759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:40.975774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:40.999299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1074/2134] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:40 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:41.003411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.012452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd26d5f-2783-48e3-857c-11ce5f1bf6e4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.012987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585437c7-0da5-4f58-b9bd-ecfeb4949574 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.016465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.017047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.017359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.017594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.018315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.019156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.019401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.019671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.020510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.022124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.028603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.030083 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.033097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1075/2135] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:41.043965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.056404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57be6c-8f3a-451d-a0c2-7dc32c1cd1cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.059775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1061/2136] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:41.062670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.063339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.063767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.063969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.064615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.066379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d351a-6c44-495f-ada2-6f29f65167fb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.078373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1076/2137] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:41.084116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.096018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca6bd-5d7c-4b7f-bbb3-081b82d214e7 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.101622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.103437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.104244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.104812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] PATH_INFO: `/v3/projects/e5b621743b5847248ca3ac7492d4f338/users/15a7df6befeb4954a7af83dcf8764920/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.125689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b621743b5847248ca3ac7492d4f338, user_id=15a7df6befeb4954a7af83dcf8764920, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.128421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.143751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1062/2138] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:41 2022] PUT /identity/v3/projects/e5b621743b5847248ca3ac7492d4f338/users/15a7df6befeb4954a7af83dcf8764920/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:41.148945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.149393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.149701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.169470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:41.170711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:41.191906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:41.241550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1077/2139] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:41.251561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.256200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:41.317657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8177-9b97-4fa2-9661-3219d815ae03 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.321796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.322414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.323162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.323162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.333725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.335137 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.345763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1063/2140] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:41.376917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.378681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:41.395405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442b79-c218-4eb3-a90a-267476fb8537 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.405723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.406653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.406863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.407198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] PATH_INFO: `/v3/projects/9f83756616b245058f98ed0007b2a5cf` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.409529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f83756616b245058f98ed0007b2a5cf)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.411354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.461979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f83756616b245058f98ed0007b2a5cf', 'request_id': 'req-458ec12a-da64-4658-82fd-66c00d3b056a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.468628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f83756616b245058f98ed0007b2a5cf', 'request_id': 'req-458ec12a-da64-4658-82fd-66c00d3b056a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.476731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f83756616b245058f98ed0007b2a5cf', 'request_id': 'req-458ec12a-da64-4658-82fd-66c00d3b056a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.487920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] The token cache is being invalidate because project 9f83756616b245058f98ed0007b2a5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:41.488239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.488907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.490465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1078/2141] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:41 2022] DELETE /identity/v3/projects/9f83756616b245058f98ed0007b2a5cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:41.494746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:41.504834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60d73-4567-4e2a-a296-a106c0a1e49a service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:41.578179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:41.578828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:41.579103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:41.579480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] PATH_INFO: `/v3/users/a5a507cfc06b46b98af0da41389ec6f8` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:41.582051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a507cfc06b46b98af0da41389ec6f8)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:41.584062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:41.648605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a507cfc06b46b98af0da41389ec6f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.657880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a507cfc06b46b98af0da41389ec6f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.665559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a507cfc06b46b98af0da41389ec6f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.666397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a507cfc06b46b98af0da41389ec6f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.680956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9e9d8fc8-141e-4a4c-b747-b1e9adeb3a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a507cfc06b46b98af0da41389ec6f8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:41.688711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1064/2142] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:41 2022] DELETE /identity/v3/users/a5a507cfc06b46b98af0da41389ec6f8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:42.186664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.188441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.206534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec12a-da64-4658-82fd-66c00d3b056a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.305371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.306927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.306927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.356104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.360120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.360671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.361050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] PATH_INFO: `/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.362507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f8fc97e5a3400283e2c311e9e761a8)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.363358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] MFA Rules not processed for user `15a7df6befeb4954a7af83dcf8764920`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:42.364607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.364812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.394574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:42.427596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f8fc97e5a3400283e2c311e9e761a8', 'request_id': 'req-fce67fb4-82a4-45af-9bc0-5568d7fe984a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:42.429911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:42.443436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f8fc97e5a3400283e2c311e9e761a8', 'request_id': 'req-fce67fb4-82a4-45af-9bc0-5568d7fe984a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:42.448611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f8fc97e5a3400283e2c311e9e761a8', 'request_id': 'req-fce67fb4-82a4-45af-9bc0-5568d7fe984a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:42.462018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] The token cache is being invalidate because project d1f8fc97e5a3400283e2c311e9e761a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:42.462476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:42.463632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-fce67fb4-82a4-45af-9bc0-5568d7fe984a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:42.465796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1079/2143] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:42 2022] DELETE /identity/v3/projects/d1f8fc97e5a3400283e2c311e9e761a8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:42.469906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1065/2144] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:42.470579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cd30-030e-4681-a9e9-861fef982a60 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.470868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cd30-030e-4681-a9e9-861fef982a60 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.471158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329cd30-030e-4681-a9e9-861fef982a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.474898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.477294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.492240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f329cd30-030e-4681-a9e9-861fef982a60 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:42.493487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f329cd30-030e-4681-a9e9-861fef982a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.494951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba0249-c25a-4375-b233-45aa14e512fa None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.572737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.574142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.575163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.575719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.576552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.579636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.608507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1080/2145] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:42.621793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.622086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.622363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.630478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1066/2146] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:42.635410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.638993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.644081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:42.645290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:42.712423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a83a3-1321-498c-a24e-a676c071606c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.717706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.718324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.718630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.718905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.720025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1081/2147] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:42.720273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.722305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.724127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.736141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec556ce-ff28-4d16-b68d-768d74cd0f2d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.744894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.745547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.745827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.746116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.746740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:42.746846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1067/2148] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:42.747046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.748691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.751096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.762517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eac87-66fc-4a3b-a410-d8734e7173be admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.763035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1082/2149] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:42.767421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.767779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.768419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.768721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.768960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.769613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.771291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.780242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612d81e-4698-47fb-80de-cdb5219b8829 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.787398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1068/2150] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:42.787570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.787570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.787570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.787570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.787952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.789085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.789212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.800370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38980a-6202-477c-a7e0-ee7b00a09bf5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.807453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.808211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.808584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.808925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] PATH_INFO: `/v3/projects/a663daf6c9a641978d69f05b23ee6a50/users/95bc275d19454f8bbd91608d40a51bfa/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.827670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663daf6c9a641978d69f05b23ee6a50, user_id=95bc275d19454f8bbd91608d40a51bfa, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.830811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.833082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1083/2151] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:42.837195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.837321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:42.852631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1069/2152] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:42 2022] PUT /identity/v3/projects/a663daf6c9a641978d69f05b23ee6a50/users/95bc275d19454f8bbd91608d40a51bfa/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:42.857575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.897179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:42.913919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a6ea-fdf8-4101-a107-554963ca0a3a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.931962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77227ad-2151-42ec-9815-8b251ad9d3a5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.936770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.937459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.937734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.938011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.938656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.940319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.954152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1070/2153] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:42.955533 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:42.965582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82e14-1905-41d4-8147-5f32d16f572d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:42.970197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.970836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.971111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.971410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] PATH_INFO: `/v3/projects/a663daf6c9a641978d69f05b23ee6a50/users/95bc275d19454f8bbd91608d40a51bfa/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.973285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663daf6c9a641978d69f05b23ee6a50, user_id=95bc275d19454f8bbd91608d40a51bfa, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.973813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:42.974426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:42.974705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:42.974974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:42.975645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:42.975965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.977528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:42.986734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1071/2154] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:42 2022] PUT /identity/v3/projects/a663daf6c9a641978d69f05b23ee6a50/users/95bc275d19454f8bbd91608d40a51bfa/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:43.005645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1084/2155] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:42 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:43.009897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.080062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aa9c7-e941-436a-bfe8-9b3ae0ffbadd admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.084827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.085441 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.085753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.085994 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.086638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.088385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.098742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1072/2156] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:43.102920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.113261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49dd9-af92-435e-a4ab-954ad61d2ac3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.118525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.119261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.119603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.119988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.120696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.122367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539abc7e-7d38-4c4e-9c1d-631de9ebaf38 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.134272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1085/2157] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:43.138920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.150392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbaa9-b67a-4d5f-9842-9971ec8a2d1b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.175692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.176560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.176846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.177119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] PATH_INFO: `/v3/projects/f25e7d7a9421473389d2dfb3c2874c4e/users/3e32c09fc1c24b8dbf5a64c63ecf3050/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.202791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25e7d7a9421473389d2dfb3c2874c4e, user_id=3e32c09fc1c24b8dbf5a64c63ecf3050, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.208568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.247721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1073/2158] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:43 2022] PUT /identity/v3/projects/f25e7d7a9421473389d2dfb3c2874c4e/users/3e32c09fc1c24b8dbf5a64c63ecf3050/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:43.249996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.250488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.250671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.281327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] MFA Rules not processed for user `3e32c09fc1c24b8dbf5a64c63ecf3050`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:43.282939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:43.371457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1086/2159] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:43.372852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.479811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:43.512251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00469eb1-c4c8-42a0-bed6-e8a3e4dd8327 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.524316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.526549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.527369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.527369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.527830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.530284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.587118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1074/2160] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:43 2022] POST /identity/v3/projects => generated 399 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:43.591556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.617882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221899af-5e19-4fbe-b302-55eabc6e735c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.783690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.784574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.785048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.785507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.786361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.789191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.821449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:43.854680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1087/2161] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:43 2022] POST /identity/v3/users => generated 306 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:43.858354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.881753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8325-d502-4254-89c3-2435b42df268 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.902130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.902805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.903087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.903919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.904594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.906283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:43.929808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1075/2162] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:43.934233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:43.953451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05284c7-c6e3-43f5-a5b5-3afd1ec2778a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:43.959584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:43.960728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:43.961187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:43.962102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] PATH_INFO: `/v3/projects/c13f6e324b214b80b88f397f3c2d4928/users/a5fde3d7a0264abe987948004188793b/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:43.994975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f6e324b214b80b88f397f3c2d4928, user_id=a5fde3d7a0264abe987948004188793b, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:43.998850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.027739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1088/2163] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:43 2022] PUT /identity/v3/projects/c13f6e324b214b80b88f397f3c2d4928/users/a5fde3d7a0264abe987948004188793b/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:44.031982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.048603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb718b-6ebf-4b5f-9243-4fcd2ff709d4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.220041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.220918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.220918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.221205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.222068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.222199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:44.224437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.224793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.239311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1076/2164] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:44.242088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042c14-e2fd-46f7-b2f6-1564ddafa536 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.242321 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.247719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.248390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.249054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.250211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] PATH_INFO: `/v3/users/2744339991814428a9eeb9249d40b615` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.251382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2744339991814428a9eeb9249d40b615)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:44.253631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.262717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb3b8-ff77-4676-aee7-fe64d6c920c8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.269536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.270536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.270817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.271136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] PATH_INFO: `/v3/projects/c13f6e324b214b80b88f397f3c2d4928/users/a5fde3d7a0264abe987948004188793b/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.273486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f6e324b214b80b88f397f3c2d4928, user_id=a5fde3d7a0264abe987948004188793b, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:44.276801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df91a2-5a95-4283-92b7-ea01c94c0cdd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.289868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1077/2165] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:44 2022] PUT /identity/v3/projects/c13f6e324b214b80b88f397f3c2d4928/users/a5fde3d7a0264abe987948004188793b/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:44.301064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.301352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.301632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.334244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2744339991814428a9eeb9249d40b615'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:44.335569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] MFA Rules not processed for user `a5fde3d7a0264abe987948004188793b`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:44.335784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2744339991814428a9eeb9249d40b615'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:44.336620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2744339991814428a9eeb9249d40b615'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:44.336869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.355671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2744339991814428a9eeb9249d40b615'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:44.366484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-56116f2f-8681-4ca6-8de6-d5048ab167ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2744339991814428a9eeb9249d40b615'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:44.394887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1089/2166] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:44 2022] DELETE /identity/v3/users/2744339991814428a9eeb9249d40b615 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:44.399671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.400307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.400583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.423877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1078/2167] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:44.423999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:44.425238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.428475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.431149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.466417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:44.495725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c9273-3ae4-4184-8c5b-31be9c8e80e7 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.500589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1090/2168] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:44.510527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.512425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.577145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:44.584518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.585313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.585633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.585853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.615659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020dcfa-024f-45c0-ac25-9f8e247f5271 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.634439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.635174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.635533 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.635868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.659554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:44.659554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701574e-4622-4091-a70b-c30a26cdb966 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.665457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1091/2169] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:44.704766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:44.706990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:44.730878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1079/2170] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:44.860745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec551c-75b8-40ce-a9e5-93840e1d0fe7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.861030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec551c-75b8-40ce-a9e5-93840e1d0fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.861301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec551c-75b8-40ce-a9e5-93840e1d0fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.894160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:44.908617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-69ec551c-75b8-40ce-a9e5-93840e1d0fe7 None None] MFA Rules not processed for user `95bc275d19454f8bbd91608d40a51bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:44.909061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6ca7-c464-4517-a505-7e938a289eb3 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:44.909926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-69ec551c-75b8-40ce-a9e5-93840e1d0fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:44.920885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:44.924284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:44.929022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:44.939350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:44.942033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.010035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1092/2171] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:45.022550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.022901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.023246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.026095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:45.033605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:45.052243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] MFA Rules not processed for user `15a7df6befeb4954a7af83dcf8764920`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:45.053486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.062500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1080/2172] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:45.163901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1093/2173] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:45.175150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:45.181531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.262616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:45.329657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:45.332030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.345949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649dd6-cb64-4ab4-bbee-9b346b3ae306 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:45.354192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:45.355094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.355508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.355882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.356110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d218f8f-e1b3-48bf-8580-4aaeddbee143 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:45.358149 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.361790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:45.362810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.363344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.363785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] PATH_INFO: `/v3/users/14089e2e603b411397870452d4568024` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.366123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14089e2e603b411397870452d4568024)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:45.368685 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:45.372825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:45.375408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:45.387871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1081/2174] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:45.450468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14089e2e603b411397870452d4568024'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.452368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14089e2e603b411397870452d4568024'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.453945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14089e2e603b411397870452d4568024'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.475667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14089e2e603b411397870452d4568024'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.494113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:45.495602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.496482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b3378c1f-0b25-4f1a-9c25-b9b1bda6524f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14089e2e603b411397870452d4568024'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.502765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:45.522159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1094/2175] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:45 2022] DELETE /identity/v3/users/14089e2e603b411397870452d4568024 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:45.527063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03f61-ec0a-47f0-b807-06b324057310 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:45.527242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.529255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.529769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.575174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:45.577050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.633191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:45.634132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.634599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.634965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] PATH_INFO: `/v3/projects/04692053fb8f49aba52a752760ba6c4c` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.636404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=04692053fb8f49aba52a752760ba6c4c)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:45.638796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:45.670341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1095/2176] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:45.680424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:45.681887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.699599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04692053fb8f49aba52a752760ba6c4c', 'request_id': 'req-0721ced2-5462-4727-aca5-b1697a77bcfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.706540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04692053fb8f49aba52a752760ba6c4c', 'request_id': 'req-0721ced2-5462-4727-aca5-b1697a77bcfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.713086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04692053fb8f49aba52a752760ba6c4c', 'request_id': 'req-0721ced2-5462-4727-aca5-b1697a77bcfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.731103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] The token cache is being invalidate because project 04692053fb8f49aba52a752760ba6c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:45.731452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.732795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0721ced2-5462-4727-aca5-b1697a77bcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:45.738787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1082/2177] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:45 2022] DELETE /identity/v3/projects/04692053fb8f49aba52a752760ba6c4c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:45.740419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97201d4-befb-49a1-b84b-c451ab0c33bd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.740921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97201d4-befb-49a1-b84b-c451ab0c33bd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.741342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97201d4-befb-49a1-b84b-c451ab0c33bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.752008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e323-1fa2-4953-98fd-e34c8a03e187 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:45.796704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f97201d4-befb-49a1-b84b-c451ab0c33bd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:45.797970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f97201d4-befb-49a1-b84b-c451ab0c33bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.840603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:45.842665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.842984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.843296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.845280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.894867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:45.934038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1083/2178] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:45.936799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:45.943809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:45.944327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:45.944854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:45.961460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:45.963229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:45.969047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:45.970421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:45.983733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1084/2179] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:45.985738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1096/2180] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:45.987695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.004887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6053-29ea-43ee-9add-fac19e50709d None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.010873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.011618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.011948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.012322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.013056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:46.014831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.016816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.040132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1085/2181] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:46.042926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.059111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550ed86-8098-499c-b266-f41e8aec0c5e service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.061641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.062307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.065458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.065800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.066497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.068623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.112757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1097/2182] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:46 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:46.117227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.132312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345e75-66bc-4c80-83bf-49bae5b51562 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.221973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.222619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.222944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.223314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.224012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.226477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.255736 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1086/2183] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:46 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:46.259577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.288438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096e53-7895-4f21-8347-61aa757791f3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.302928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.306939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.307347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.307751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.311012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.313344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.341409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1098/2184] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:46.351630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.364983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22919-1e51-4a81-aa9b-f64b6a02bac8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.371975 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.374349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:46.384608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.386825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.387558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.388809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.389631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.393411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.398590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebbd81-d5e6-4403-b9dd-ab3591dac28d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.412073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.412637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.412974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.413238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] PATH_INFO: `/v3/projects/d8e38edd6fd34552a1cbcccb344d2277` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.415489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e38edd6fd34552a1cbcccb344d2277)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.415980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1087/2185] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:46.420350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.423771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.435498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cb486-8408-4de0-9cb2-f3549644ab07 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.447235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.447235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.447235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.447235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] PATH_INFO: `/v3/projects/30be0080223a4df7974c994bec589e1c/users/d17b75fd61814b79b81dcaea46d9949f/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.479340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30be0080223a4df7974c994bec589e1c, user_id=d17b75fd61814b79b81dcaea46d9949f, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.482117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd53e6-3b76-41b4-9627-081c55cc95b8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.508639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1088/2186] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:46 2022] PUT /identity/v3/projects/30be0080223a4df7974c994bec589e1c/users/d17b75fd61814b79b81dcaea46d9949f/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:46.509440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e38edd6fd34552a1cbcccb344d2277', 'request_id': 'req-ad92f75f-5b0e-4d50-b265-9c159825cf26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.522421 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e38edd6fd34552a1cbcccb344d2277', 'request_id': 'req-ad92f75f-5b0e-4d50-b265-9c159825cf26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.523390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.523892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.524368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.535929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e38edd6fd34552a1cbcccb344d2277', 'request_id': 'req-ad92f75f-5b0e-4d50-b265-9c159825cf26'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.556872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] The token cache is being invalidate because project d8e38edd6fd34552a1cbcccb344d2277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:46.557110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.557790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.558813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] MFA Rules not processed for user `d17b75fd61814b79b81dcaea46d9949f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:46.559926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1099/2187] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:46 2022] DELETE /identity/v3/projects/d8e38edd6fd34552a1cbcccb344d2277 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:46.560752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:46.564075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.565851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:46.695843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f75f-5b0e-4d50-b265-9c159825cf26 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.702316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.703297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.703664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.704555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] PATH_INFO: `/v3/users/12c59c96a0be47b594ee9f619a45b3b7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:46.705631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c59c96a0be47b594ee9f619a45b3b7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:46.708075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:46.723666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1089/2188] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:46.736799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:46.743946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:46.795104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:46.797069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:46.802139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c59c96a0be47b594ee9f619a45b3b7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.803407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c59c96a0be47b594ee9f619a45b3b7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.805315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c59c96a0be47b594ee9f619a45b3b7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.818542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c59c96a0be47b594ee9f619a45b3b7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.831462 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c59c96a0be47b594ee9f619a45b3b7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:46.857148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1100/2189] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:46 2022] DELETE /identity/v3/users/12c59c96a0be47b594ee9f619a45b3b7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:46.874949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8926-b66f-4ae0-bc11-5918df6805cf None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:46.988034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:46.989897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:46.991117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:46.993983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:47.000817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:47.224875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:47.226447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:47.265528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:47.268078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:47.289146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1090/2190] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:47.451508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b9cb-ac99-4c8f-a93b-7ec37ce5dc74 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:47.458457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:47.459152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:47.459470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:47.459745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] PATH_INFO: `/v3/projects/f38d35c53fd649de92ecc32216abb405` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:47.460959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38d35c53fd649de92ecc32216abb405)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:47.463300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:47.530708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38d35c53fd649de92ecc32216abb405', 'request_id': 'req-a554a184-2fd2-44a7-8891-24c62210fc7f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.538692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38d35c53fd649de92ecc32216abb405', 'request_id': 'req-a554a184-2fd2-44a7-8891-24c62210fc7f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.552247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38d35c53fd649de92ecc32216abb405', 'request_id': 'req-a554a184-2fd2-44a7-8891-24c62210fc7f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.567528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] The token cache is being invalidate because project f38d35c53fd649de92ecc32216abb405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:47.568644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.569400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.571353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1101/2191] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:47 2022] DELETE /identity/v3/projects/f38d35c53fd649de92ecc32216abb405 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:47.575595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:47.589254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cea0e-c815-422a-8bd0-5852ac4af771 service glance] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:47.675448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:47.677180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:47.677463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:47.677726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] PATH_INFO: `/v3/users/bac63b2051a345e1b3e8f334f4822fcb` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:47.678893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac63b2051a345e1b3e8f334f4822fcb)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:47.680898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:47.740842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:47.768087 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac63b2051a345e1b3e8f334f4822fcb'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.778646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac63b2051a345e1b3e8f334f4822fcb'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.788055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac63b2051a345e1b3e8f334f4822fcb'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.788904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac63b2051a345e1b3e8f334f4822fcb'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.825883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7bc8ff45-5a17-40f9-be53-7b9abd8385b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac63b2051a345e1b3e8f334f4822fcb'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:47.844859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1091/2192] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:47 2022] DELETE /identity/v3/users/bac63b2051a345e1b3e8f334f4822fcb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:48.548666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:48.557206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:48.599860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a184-2fd2-44a7-8891-24c62210fc7f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:48.748175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:48.776052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:48.776959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:48.777235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:48.777905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] PATH_INFO: `/v3/projects/36ff56a841ee4769a202003e30f96ba4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:48.782416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ff56a841ee4769a202003e30f96ba4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:48.784628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:48.875388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ff56a841ee4769a202003e30f96ba4', 'request_id': 'req-c4764322-d954-46ed-a8aa-ae2261953dd2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:48.886946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ff56a841ee4769a202003e30f96ba4', 'request_id': 'req-c4764322-d954-46ed-a8aa-ae2261953dd2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:48.902054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ff56a841ee4769a202003e30f96ba4', 'request_id': 'req-c4764322-d954-46ed-a8aa-ae2261953dd2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:48.916313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] The token cache is being invalidate because project 36ff56a841ee4769a202003e30f96ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:48.916600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:48.917406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c4764322-d954-46ed-a8aa-ae2261953dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:48.919003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1102/2193] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:48 2022] DELETE /identity/v3/projects/36ff56a841ee4769a202003e30f96ba4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:48.924814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:48.925368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:48.925368 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:48.946298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:48.947541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:49.043764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1092/2194] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:49.045683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.046007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.046292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.075251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:49.076610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:49.090144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1103/2195] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:49.095067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.113726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bc9cb-29d1-4d14-b0ff-d243b20ceeee None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.120235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.120878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.121160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.121446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.122263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:49.122572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.124386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.147312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.159654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1093/2196] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:14:49.165471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db138a-aa2c-45ca-a96a-6fa99a190dbc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.187020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.187766 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.188043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.188314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.188987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.190957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.229736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1104/2197] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:49.234301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.258162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c97542-3fa7-4a6b-952b-ce5134f9996e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.343164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.344327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.344858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.345237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.346344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.353633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.383490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1094/2198] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:49.385030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.395772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9456-13bd-440a-aeac-75268b6fdf36 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.406157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.407392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.407695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.407937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.408601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.410967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.423078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1105/2199] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:49.426662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.437526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305878d4-40e8-4432-af46-50c65f714277 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.443944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.444546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.444841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.445119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.445797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.447551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0822b-89d1-4324-a853-c34c3fab690a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.460247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1095/2200] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:49.464522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.474616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4247e-ae80-40d8-82d5-23820913dbd9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.479259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.479942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.480222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.480496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] PATH_INFO: `/v3/projects/4099e298441748ca8f1298460309ed8e/users/6b89ac99cb864ca4a166abf36f1b3c8e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.495702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4099e298441748ca8f1298460309ed8e, user_id=6b89ac99cb864ca4a166abf36f1b3c8e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.498457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.515028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1106/2201] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:49 2022] PUT /identity/v3/projects/4099e298441748ca8f1298460309ed8e/users/6b89ac99cb864ca4a166abf36f1b3c8e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:49.526265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a13b2-028c-4646-9266-95ca807c770c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.526551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a13b2-028c-4646-9266-95ca807c770c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.526818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a13b2-028c-4646-9266-95ca807c770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.548500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:49.557141 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-263a13b2-028c-4646-9266-95ca807c770c None None] MFA Rules not processed for user `6b89ac99cb864ca4a166abf36f1b3c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:49.559450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-263a13b2-028c-4646-9266-95ca807c770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:49.638497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1096/2202] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:49.643387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.747762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75714688-545d-4b6c-a776-c47a90d4f7d6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.754074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.755058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.755862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.756210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.756984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.759008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.795228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1107/2203] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:49.797102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a13b2-028c-4646-9266-95ca807c770c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.808262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a13b2-028c-4646-9266-95ca807c770c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.850588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.852571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:49.857650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:49.896537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.897471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.897775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.898201 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.899249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.902369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.935220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1097/2204] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:49 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:49.938638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:49.952401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb593a-316e-4885-bf05-860a7fca5c0b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.953667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a04be-2e6c-4476-b54e-8330d32b5c55 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:49.960274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.961206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.961654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.962086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] PATH_INFO: `/v3/users/3e32c09fc1c24b8dbf5a64c63ecf3050` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.964836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e32c09fc1c24b8dbf5a64c63ecf3050)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.967893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.968186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:49.969247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:49.969717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:49.970132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:49.971126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:49.973404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:49.992700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1098/2205] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:49.993730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.009794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8858d03-a522-444b-a2b8-b7b1f285c2fe admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.016251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.017032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.017514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.017937 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.019014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.021034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.040254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1099/2206] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:50.040776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.041809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e32c09fc1c24b8dbf5a64c63ecf3050'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:50.042483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e32c09fc1c24b8dbf5a64c63ecf3050'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:50.043124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e32c09fc1c24b8dbf5a64c63ecf3050'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:50.053171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8131-8ecc-4478-9700-072979090eb1 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.057100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e32c09fc1c24b8dbf5a64c63ecf3050'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:50.062544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.063675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.066438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.066732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] PATH_INFO: `/v3/projects/5a82c51d7f1546969eaa486284dece57/users/f734fe654fe346958a421e32f90c13e5/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.073507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d1687e50-7086-400e-aa05-e6d1e4cac446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e32c09fc1c24b8dbf5a64c63ecf3050'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:50.088778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a82c51d7f1546969eaa486284dece57, user_id=f734fe654fe346958a421e32f90c13e5, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.091948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35311c8-255f-4fb1-a8c5-d445ed23a8a7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.099236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1108/2207] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:49 2022] DELETE /identity/v3/users/3e32c09fc1c24b8dbf5a64c63ecf3050 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:50.103789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.104085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.104408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.116901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1100/2208] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:50 2022] PUT /identity/v3/projects/5a82c51d7f1546969eaa486284dece57/users/f734fe654fe346958a421e32f90c13e5/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:50.131087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:50.138040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:50.192709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.192709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.192969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.253832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] MFA Rules not processed for user `f734fe654fe346958a421e32f90c13e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:50.255813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:50.273232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1109/2209] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:50.282025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.285961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:50.325716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:50.350218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:50.372318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1101/2210] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:50.376897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.378523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:50.405542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd90bd3-ddc8-4845-8ab4-64e360478e93 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.410981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60fa2f-d873-4ed9-8ee4-627dac6c9bb4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.416059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.416901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.417339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.418107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.418722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.418854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.419938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.420369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.420854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.421193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.437018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.438882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.450722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1110/2211] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:50.478344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1102/2212] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:50 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:50.482165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.492606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3bbd-f2e9-4170-a132-03837939e744 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.590205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.590835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.591120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.591471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.592076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.594092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.639230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1111/2213] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:50 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:50.640047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.653675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75a43-8b1e-4414-88de-9322f8fdf386 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.660360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.661386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.662264 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.662672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.664328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.666982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.686354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1103/2214] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:50.687023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.722081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1fc27-4ddc-405b-9f8a-2d0ba25aaa7f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.727719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.728848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.729141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.729649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] PATH_INFO: `/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484/users/0a6630276abc4e119a7dc12596700de3/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.750453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17da24cc8e2e4b01b8ee66fea3b5e484, user_id=0a6630276abc4e119a7dc12596700de3, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.753581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.778340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1112/2215] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:50 2022] PUT /identity/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484/users/0a6630276abc4e119a7dc12596700de3/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:50.783000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.810604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b2476-5596-4f60-adb9-85c5af91d342 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.894913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.907432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:50.916702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.919471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.919926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.920361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.921040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.923681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.946448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1104/2216] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:50.949550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:50.962142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd847-1901-45ce-819e-43285101a828 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.967242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.967905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.968180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.969169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] PATH_INFO: `/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484/users/0a6630276abc4e119a7dc12596700de3/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.971216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17da24cc8e2e4b01b8ee66fea3b5e484, user_id=0a6630276abc4e119a7dc12596700de3, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.973944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058865-6073-45a1-8470-a895e90375f3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.978537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d6390-38b6-4660-927d-3bff08be99f3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:50.983605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:50.984369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.984672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.984918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] PATH_INFO: `/v3/projects/f25e7d7a9421473389d2dfb3c2874c4e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:50.986047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25e7d7a9421473389d2dfb3c2874c4e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:50.991286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1105/2217] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:50 2022] PUT /identity/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484/users/0a6630276abc4e119a7dc12596700de3/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:50.991555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:50.996792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:50.997775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:50.998050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:51.029952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] MFA Rules not processed for user `0a6630276abc4e119a7dc12596700de3`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:51.031251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.034669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:51.051961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25e7d7a9421473389d2dfb3c2874c4e', 'request_id': 'req-0188d67a-8a5b-454b-8095-15f160bf32c9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.063070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25e7d7a9421473389d2dfb3c2874c4e', 'request_id': 'req-0188d67a-8a5b-454b-8095-15f160bf32c9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.072941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25e7d7a9421473389d2dfb3c2874c4e', 'request_id': 'req-0188d67a-8a5b-454b-8095-15f160bf32c9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.085584 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] The token cache is being invalidate because project f25e7d7a9421473389d2dfb3c2874c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:51.086047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.086744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.088754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1113/2218] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:50 2022] DELETE /identity/v3/projects/f25e7d7a9421473389d2dfb3c2874c4e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:51.092535 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:51.094086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.145805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1106/2219] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:51.160688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:51.162378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.182174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:51.197183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188d67a-8a5b-454b-8095-15f160bf32c9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:51.202193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:51.203260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:51.203546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:51.203832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] PATH_INFO: `/v3/users/a5fde3d7a0264abe987948004188793b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:51.204947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fde3d7a0264abe987948004188793b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:51.207045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:51.240757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb4cec-a456-4696-9185-b126aab51a9c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:51.245999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:51.247227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:51.247377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:51.247565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:51.249459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.262760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fde3d7a0264abe987948004188793b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.263475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fde3d7a0264abe987948004188793b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.264095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fde3d7a0264abe987948004188793b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.274608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fde3d7a0264abe987948004188793b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.283968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fde3d7a0264abe987948004188793b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.313789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1114/2220] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:51 2022] DELETE /identity/v3/users/a5fde3d7a0264abe987948004188793b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:51.341509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:51.343216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017bb7-daa2-4d09-a30f-9bfe8db840ac service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:51.356091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1107/2221] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:51.690700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:51.693018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.774411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:51.798488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811fe85-9436-4b55-9f0f-8d277892430d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:51.803231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:51.803865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:51.804141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:51.804409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] PATH_INFO: `/v3/projects/c13f6e324b214b80b88f397f3c2d4928` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:51.805522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13f6e324b214b80b88f397f3c2d4928)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:51.807465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:51.855790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13f6e324b214b80b88f397f3c2d4928', 'request_id': 'req-74c39870-f759-40a6-acbf-8eda4fe356d2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.862051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13f6e324b214b80b88f397f3c2d4928', 'request_id': 'req-74c39870-f759-40a6-acbf-8eda4fe356d2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.871565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13f6e324b214b80b88f397f3c2d4928', 'request_id': 'req-74c39870-f759-40a6-acbf-8eda4fe356d2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.882728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] The token cache is being invalidate because project c13f6e324b214b80b88f397f3c2d4928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:51.883014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.883663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-74c39870-f759-40a6-acbf-8eda4fe356d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:51.885412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1115/2222] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:51 2022] DELETE /identity/v3/projects/c13f6e324b214b80b88f397f3c2d4928 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:51.890831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:51.891112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:51.891410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:51.913062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:51.914447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:51.979852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1108/2223] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:51.987854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:51.988144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:51.989416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.012158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:52.013414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:52.022818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1116/2224] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:52.028204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.038397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c3eb-2d14-4d0a-bd8f-82a9a4d0c8f1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.043369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.043982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.044257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.044526 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.045175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:52.045475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.047233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.059739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1109/2225] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:52.064381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.074093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8a47f-5a96-4c07-beae-7ddcb4a23ade None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.079403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.080026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.080326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.080600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.081254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.083375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.118661 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1117/2226] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:52 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:52.119852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.130552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53554cb8-df45-4f44-a17c-4d200257a21e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.179294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.190941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.191593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.191868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.192133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.192768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.194758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.219749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1110/2227] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:52 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:52.220971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.232881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9ea3-018b-4e79-96a6-bce495e24bdf admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.238439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.239176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.239412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.239680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.240330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.241923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.252898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1118/2228] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:52.257227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.267650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba240a-87f2-4760-90da-3bd2338fe0c4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.276223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.276223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.276223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.276223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.276694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.277474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fab2ea-e655-4116-bb3d-5c0a02cac367 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.290292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1111/2229] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:52.294649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.305299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e353-2898-4e67-9dd9-f0df7064bbe8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.310319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.310972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.311251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.311541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] PATH_INFO: `/v3/projects/008b55cc16fa42a19a087807bb1f9622/users/c4cb3c24995c4f69be6338681a21ceb2/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.327204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008b55cc16fa42a19a087807bb1f9622, user_id=c4cb3c24995c4f69be6338681a21ceb2, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.329997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.345723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1119/2230] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:52 2022] PUT /identity/v3/projects/008b55cc16fa42a19a087807bb1f9622/users/c4cb3c24995c4f69be6338681a21ceb2/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:52.357500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.357780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.358037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.389393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] MFA Rules not processed for user `c4cb3c24995c4f69be6338681a21ceb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:52.390772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:52.462727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1112/2231] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:52.464442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.530025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1204-dc34-412e-9d65-4a1b1a8bc3b9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.534970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.535611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.536012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.536285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.539224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.539224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.553495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:52.574340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1120/2232] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:52 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:52.576723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.587797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8026e25-0ed5-4a5c-92bf-4306eae1b92a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.663251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.664181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.664523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.664864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.665592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.668285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.704191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1113/2233] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:52 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:52.706046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.719246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560eccf-c95d-49c1-90de-f7201805230f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.728505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.729390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.729867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.730319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.731062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.737467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.753463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1121/2234] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:52.757897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.773685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b18228-c729-4b3c-9b2b-2ffa02e8a1de admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.783751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.784719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.785165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.785611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] PATH_INFO: `/v3/projects/5cc36c60865e47c49aea3d1c895a08f5/users/598d38b99ddf497c8f752c334f1ddbfc/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.824104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc36c60865e47c49aea3d1c895a08f5, user_id=598d38b99ddf497c8f752c334f1ddbfc, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.832217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.862346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1114/2235] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:52 2022] PUT /identity/v3/projects/5cc36c60865e47c49aea3d1c895a08f5/users/598d38b99ddf497c8f752c334f1ddbfc/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:52.866662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.878925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c318e-23b2-4d9c-b81f-5bcfb8624c18 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.948879 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.949554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.949833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.950100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:52.950833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:52.952566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:52.964317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1122/2236] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:52.971289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.987080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:52.988867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:52.989502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b259ae-4bcc-4068-a728-12739ae3b792 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:52.995352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:52.996234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:52.996697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:52.997726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] PATH_INFO: `/v3/projects/5cc36c60865e47c49aea3d1c895a08f5/users/598d38b99ddf497c8f752c334f1ddbfc/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:53.000576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc36c60865e47c49aea3d1c895a08f5, user_id=598d38b99ddf497c8f752c334f1ddbfc, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:53.005250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5a65d-8763-408d-b13c-32055cf78111 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:53.034621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1115/2237] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:52 2022] PUT /identity/v3/projects/5cc36c60865e47c49aea3d1c895a08f5/users/598d38b99ddf497c8f752c334f1ddbfc/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:53.036420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:53.036710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:53.036980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:53.059674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:53.070872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199240c0-f8d1-4e7e-879c-5dea31981398 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:53.074299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] MFA Rules not processed for user `598d38b99ddf497c8f752c334f1ddbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:53.075584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:53.157907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:53.158795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:53.159079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:53.159407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:53.162117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:53.165899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1116/2238] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:53.176974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:53.178434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:53.191101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97961f52-b055-490e-8e3e-b032a148ddd6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:53.197473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:53.197473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:53.197473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:53.197473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:53.208093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:53.209648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:53.217600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:53.219747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1117/2239] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:53.234402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:53.243121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:53.253011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1123/2240] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:53.327100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:53.337063 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021460-bf91-4d7a-afd0-956511d7f1c6 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:53.342560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:53.343305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:53.343587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:53.343858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:53.416362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:53.417882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:53.431382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1118/2241] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:54.028338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:54.037282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e834-70cb-424e-bb7f-7c5fed6b78a0 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:54.041583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:54.042195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:54.042473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:54.042757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:54.044728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:54.109744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:54.111750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:54.123132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1124/2242] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:56.226768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:56.291440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:56.292893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:56.311046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a515bad-ccf7-4030-a051-3259d8f6863e service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:56.316005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:56.316651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.316932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.317211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] PATH_INFO: `/v3/users/c4cb3c24995c4f69be6338681a21ceb2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:56.318775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cb3c24995c4f69be6338681a21ceb2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:56.323528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:56.354748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:56.397398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cb3c24995c4f69be6338681a21ceb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.410593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cb3c24995c4f69be6338681a21ceb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.423955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cb3c24995c4f69be6338681a21ceb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.424683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cb3c24995c4f69be6338681a21ceb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.427701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687fda6-7f9d-49df-bcd5-58cff89e23f2 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:56.437034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:56.438725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.439890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.440193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] PATH_INFO: `/v3/users/1686820720f24e9aa3b63508b8514367` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:56.441668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4d7251c-90db-4869-9ff9-9460c4614b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cb3c24995c4f69be6338681a21ceb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.442690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1686820720f24e9aa3b63508b8514367)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:56.445716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:56.449862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1119/2243] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:56 2022] DELETE /identity/v3/users/c4cb3c24995c4f69be6338681a21ceb2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:56.454327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.454620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.454899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:56.476357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:56.480277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:56.513040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1686820720f24e9aa3b63508b8514367'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.513714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1686820720f24e9aa3b63508b8514367'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.514414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1686820720f24e9aa3b63508b8514367'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.526266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1686820720f24e9aa3b63508b8514367'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.535169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1686820720f24e9aa3b63508b8514367'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.551675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:56.557355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1125/2244] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:56 2022] DELETE /identity/v3/users/1686820720f24e9aa3b63508b8514367 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:56.565595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1120/2245] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:56.581139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:56.582599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:56.656025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe40ae8-7397-41c6-95c3-0ca4b67e9a85 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:56.660133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:56.661506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.661836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.662168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:56.734760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:56.736384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46d4ff-986b-4dde-95dc-155acd17affa service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:56.745916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:56.748236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:56.756452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1126/2246] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:56.772355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f098d-1177-41a5-bdd5-c3043845ff3c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:56.779010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:56.779733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.780627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.780952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] PATH_INFO: `/v3/projects/187b3b412da4414091f81d5969926eb0` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:56.782178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=187b3b412da4414091f81d5969926eb0)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:56.785258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:56.914363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187b3b412da4414091f81d5969926eb0', 'request_id': 'req-376e753a-5a7c-4192-a4d4-691129efac4d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.921987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187b3b412da4414091f81d5969926eb0', 'request_id': 'req-376e753a-5a7c-4192-a4d4-691129efac4d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.937579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187b3b412da4414091f81d5969926eb0', 'request_id': 'req-376e753a-5a7c-4192-a4d4-691129efac4d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.973055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] The token cache is being invalidate because project 187b3b412da4414091f81d5969926eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:56.973055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.973849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:56.977544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1121/2247] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:56 2022] DELETE /identity/v3/projects/187b3b412da4414091f81d5969926eb0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:56.982693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a1c6-2ef2-4d35-a1e9-11731672a311 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:56.983072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a1c6-2ef2-4d35-a1e9-11731672a311 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:56.983577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a1c6-2ef2-4d35-a1e9-11731672a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.026256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7eb2a1c6-2ef2-4d35-a1e9-11731672a311 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:57.029466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7eb2a1c6-2ef2-4d35-a1e9-11731672a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.122033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.123334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.125148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1127/2248] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:57.133981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.134346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.134621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.138192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e753a-5a7c-4192-a4d4-691129efac4d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.143671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.144322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.147433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.147777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] PATH_INFO: `/v3/projects/008b55cc16fa42a19a087807bb1f9622` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.149227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008b55cc16fa42a19a087807bb1f9622)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.153810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.166156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:57.167432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.183212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1128/2249] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:57.184256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.186267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:57.194269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753677-630f-45dd-a96f-e1a56a05a49a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.200494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.201151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.201401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.201665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.202315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:57.202651 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.204314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.221300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1129/2250] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:57.221871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.231136 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008b55cc16fa42a19a087807bb1f9622', 'request_id': 'req-c1d36cad-f421-48aa-ac32-55aa54936893'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.234150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41efab8-6472-4eec-8250-b3fec1501489 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.240081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008b55cc16fa42a19a087807bb1f9622', 'request_id': 'req-c1d36cad-f421-48aa-ac32-55aa54936893'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.250862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008b55cc16fa42a19a087807bb1f9622', 'request_id': 'req-c1d36cad-f421-48aa-ac32-55aa54936893'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.268196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] The token cache is being invalidate because project 008b55cc16fa42a19a087807bb1f9622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:57.268554 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.269413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.271815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1122/2251] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:57 2022] DELETE /identity/v3/projects/008b55cc16fa42a19a087807bb1f9622 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:57.275534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:57.276585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.277957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.306329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.307061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.307435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.307842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.308476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.310444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.340824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1130/2252] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:57 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:57.345067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.346736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.348491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d36cad-f421-48aa-ac32-55aa54936893 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.407962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.408608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.408931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.409205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] PATH_INFO: `/v3/users/598d38b99ddf497c8f752c334f1ddbfc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.410408 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598d38b99ddf497c8f752c334f1ddbfc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.412394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.413156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b2e9-6c26-400b-8418-c88faaf7e63b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.418573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.419207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.419494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.419818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.420458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.422404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.447419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1131/2253] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:57 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:14:57.452153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.462563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060f518-a29e-4fe7-b160-40db3a2c6aeb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.464948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598d38b99ddf497c8f752c334f1ddbfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.467329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.467958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.468314 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.468555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.469235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.470965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.473126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598d38b99ddf497c8f752c334f1ddbfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.475893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:57.482227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598d38b99ddf497c8f752c334f1ddbfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.482739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1132/2254] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:57.485998 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598d38b99ddf497c8f752c334f1ddbfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.486874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.488575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.500918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598d38b99ddf497c8f752c334f1ddbfc'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:57.501217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa25f1-0035-4918-b657-9171c6e30456 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.505940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.506553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.506914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.507166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.507528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1123/2255] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:57 2022] DELETE /identity/v3/users/598d38b99ddf497c8f752c334f1ddbfc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:57.507942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.509571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbbee-d63b-4a4f-bd39-d4599431312b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.520546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1133/2256] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:14:57.525102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.636107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608ba80-1c74-40db-92b5-e3745df3cb05 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.645816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.646875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.647428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.647918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] PATH_INFO: `/v3/projects/ca3fd5b6d526471aa68dc7157adaa25d/users/4b7f6d085f89478db97ef7da015932ef/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.673156 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3fd5b6d526471aa68dc7157adaa25d, user_id=4b7f6d085f89478db97ef7da015932ef, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.677584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.708581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1124/2257] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:57 2022] PUT /identity/v3/projects/ca3fd5b6d526471aa68dc7157adaa25d/users/4b7f6d085f89478db97ef7da015932ef/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:57.710640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.711578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.712061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.736149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:57.738420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.858472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1134/2258] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:57.873461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.875338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.917516 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:57.918931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:57.932477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71687e11-3236-4b94-a211-3209c8b7d502 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.943609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.944255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.944532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.944808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] PATH_INFO: `/v3/projects/5cc36c60865e47c49aea3d1c895a08f5` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.950544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc36c60865e47c49aea3d1c895a08f5)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.952717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:57.976208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d2e59-660a-468d-b957-3fb91eaea23a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:57.981683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:57.982039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:57.982780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:57.983126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:57.983440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:57.995844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:57.997327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8cdd4-381c-40fb-b7e6-959a13fd60ec service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.007679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1125/2259] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:58.020214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc36c60865e47c49aea3d1c895a08f5', 'request_id': 'req-eaee19d8-6d0b-4908-9938-4f448bfe17ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.029826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc36c60865e47c49aea3d1c895a08f5', 'request_id': 'req-eaee19d8-6d0b-4908-9938-4f448bfe17ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.039270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc36c60865e47c49aea3d1c895a08f5', 'request_id': 'req-eaee19d8-6d0b-4908-9938-4f448bfe17ee'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.052223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] The token cache is being invalidate because project 5cc36c60865e47c49aea3d1c895a08f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:58.052698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.053500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-eaee19d8-6d0b-4908-9938-4f448bfe17ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.058855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1135/2260] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:57 2022] DELETE /identity/v3/projects/5cc36c60865e47c49aea3d1c895a08f5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:58.060151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.060442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.060717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.088245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:58.090567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.177538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:58.193663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1126/2261] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:58.202112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.202400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.202728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.224746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:58.226019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.234841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1136/2262] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:58.243058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.254685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7981b5-e65f-4a88-9763-857c04dfd4e6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.259514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.260131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.260405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.260676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.261585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:14:58.261891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.263706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.295235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1127/2263] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:14:58.296811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.307686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba1043-f33c-48f0-b309-950cf2439130 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.316851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.317720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.318126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.318469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.319431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.321662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.361749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.361890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1137/2264] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:58.362825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.363954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.377754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05859a15-990a-4aca-a31f-bff67102da9b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.445123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.445940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.446407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.446694 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] PATH_INFO: `/v3/users/6b89ac99cb864ca4a166abf36f1b3c8e` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.448227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b89ac99cb864ca4a166abf36f1b3c8e)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.453836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f7ae8-cddb-41cc-b43a-38dd560751f2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.455714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.460395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.461117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.461581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.461915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.462992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.465440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.501695 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1138/2265] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/users => generated 281 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:14:58.504382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.515941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0744e-8071-4e83-8633-2158d2f3af0b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.525905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.526591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.526962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.527294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.527954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.529675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.544379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1139/2266] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:58.545088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.550457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b89ac99cb864ca4a166abf36f1b3c8e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.555741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bdab9-6a9c-444c-8a09-d3ae33b98681 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.561037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.561534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b89ac99cb864ca4a166abf36f1b3c8e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.561654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.561951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.562247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.562974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.565070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.570950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b89ac99cb864ca4a166abf36f1b3c8e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.572539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b89ac99cb864ca4a166abf36f1b3c8e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.579004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1140/2267] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:14:58.583443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.585514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.586877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6f4752f7-37eb-4e9b-ad4d-d0cd5f9f2173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b89ac99cb864ca4a166abf36f1b3c8e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:58.593636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1128/2268] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:58 2022] DELETE /identity/v3/users/6b89ac99cb864ca4a166abf36f1b3c8e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:58.597881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.598175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.598452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.598926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc031-20e9-4af6-a9be-ae797e37d60b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.621946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:58.623243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.662510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:58.680552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.681387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.681760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.682120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] PATH_INFO: `/v3/projects/d504ebb6c08d409289ab13f7dd92f00a/users/ab1f10c4b6c74a7e9ebd8f992cc4b536/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.698041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1129/2269] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:14:58.704259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d504ebb6c08d409289ab13f7dd92f00a, user_id=ab1f10c4b6c74a7e9ebd8f992cc4b536, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.708953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.709134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd2c9f-71e4-4bec-8022-baa35f431c9f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.709484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.720844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:58.731291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1141/2270] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:14:58 2022] PUT /identity/v3/projects/d504ebb6c08d409289ab13f7dd92f00a/users/ab1f10c4b6c74a7e9ebd8f992cc4b536/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:14:58.740229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.740610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.740959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.783945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] MFA Rules not processed for user `ab1f10c4b6c74a7e9ebd8f992cc4b536`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:58.784806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62399e-9a02-4e47-bbf8-f636d82ea75b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:58.785258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:58.850535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:58.851451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:58.851828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:58.852195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:58.910071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1142/2271] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:58.935336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:58.935336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:58.948195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1130/2272] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:58.955072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:58.956558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:59.060773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138252a5-93f8-4abb-bc62-ad33585b0be5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:59.070857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:59.071576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.071857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.072130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.082426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:59.084105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b184d2-8079-4d53-985f-62f4099be796 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:59.095311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1143/2273] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:14:59.112840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:59.124522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1de6-5c42-4214-a296-f98336d618a7 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:59.138527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:59.139463 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.139864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.140207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] PATH_INFO: `/v3/users/ab1f10c4b6c74a7e9ebd8f992cc4b536` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.141923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1f10c4b6c74a7e9ebd8f992cc4b536)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:59.144059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:59.226697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1f10c4b6c74a7e9ebd8f992cc4b536'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.240657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1f10c4b6c74a7e9ebd8f992cc4b536'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.258398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1f10c4b6c74a7e9ebd8f992cc4b536'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.258398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1f10c4b6c74a7e9ebd8f992cc4b536'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.271945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:59.292162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1f10c4b6c74a7e9ebd8f992cc4b536'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.313303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1131/2274] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:59 2022] DELETE /identity/v3/users/ab1f10c4b6c74a7e9ebd8f992cc4b536 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:59.317913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.318405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.318497 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.356963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:14:59.361737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:59.437975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:59.441412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:59.488450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1144/2275] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:14:59.496841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:59.499761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:14:59.512919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:14:59.574950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738a4db-f27d-453f-ad61-ca576d6e1189 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:59.580896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:59.581800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.582358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.582774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] PATH_INFO: `/v3/projects/4099e298441748ca8f1298460309ed8e` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.584381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4099e298441748ca8f1298460309ed8e)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:59.587353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:59.633077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdeff7-95fe-454c-9cbe-5db4e2a34e98 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:59.638093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:59.638297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.638776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.639019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.656299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:59.658716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:59.659288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4099e298441748ca8f1298460309ed8e', 'request_id': 'req-5de5fc68-677a-4cd0-b24d-eefa03be10bd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.668183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4099e298441748ca8f1298460309ed8e', 'request_id': 'req-5de5fc68-677a-4cd0-b24d-eefa03be10bd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.674730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1145/2276] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:14:59.676741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4099e298441748ca8f1298460309ed8e', 'request_id': 'req-5de5fc68-677a-4cd0-b24d-eefa03be10bd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.698829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] The token cache is being invalidate because project 4099e298441748ca8f1298460309ed8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:14:59.699200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.699985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.703275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1132/2277] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:14:59 2022] DELETE /identity/v3/projects/4099e298441748ca8f1298460309ed8e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:14:59.705980 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:14:59.725899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea61fe5-5399-4276-99af-15a6117cc249 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:14:59.822924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:14:59.823738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:14:59.824120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:14:59.824897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] PATH_INFO: `/v3/users/f734fe654fe346958a421e32f90c13e5` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:14:59.826745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f734fe654fe346958a421e32f90c13e5)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:14:59.828990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:14:59.899420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f734fe654fe346958a421e32f90c13e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.903430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f734fe654fe346958a421e32f90c13e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.904228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f734fe654fe346958a421e32f90c13e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.914293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f734fe654fe346958a421e32f90c13e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.922234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f734fe654fe346958a421e32f90c13e5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:14:59.942466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1146/2278] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:14:59 2022] DELETE /identity/v3/users/f734fe654fe346958a421e32f90c13e5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:00.329748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:00.331420 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:00.351839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fc68-677a-4cd0-b24d-eefa03be10bd admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:00.429155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:00.429815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.430097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.430370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] PATH_INFO: `/v3/projects/d504ebb6c08d409289ab13f7dd92f00a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.431560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d504ebb6c08d409289ab13f7dd92f00a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:00.433506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:00.458107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:00.464796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:00.466281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:00.487122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98dba1-c6df-4793-95ef-91c89e972457 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:00.494395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:00.495354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.495776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.496196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] PATH_INFO: `/v3/projects/5a82c51d7f1546969eaa486284dece57` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.498509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a82c51d7f1546969eaa486284dece57)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:00.500869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:00.528779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd504ebb6c08d409289ab13f7dd92f00a', 'request_id': 'req-55f7505e-9221-4328-9164-6fb97a9117e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.537989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd504ebb6c08d409289ab13f7dd92f00a', 'request_id': 'req-55f7505e-9221-4328-9164-6fb97a9117e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.545053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:00.546410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd504ebb6c08d409289ab13f7dd92f00a', 'request_id': 'req-55f7505e-9221-4328-9164-6fb97a9117e6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.568700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] The token cache is being invalidate because project d504ebb6c08d409289ab13f7dd92f00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:00.569100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.569926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-55f7505e-9221-4328-9164-6fb97a9117e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.582683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1133/2279] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:00 2022] DELETE /identity/v3/projects/d504ebb6c08d409289ab13f7dd92f00a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:00.588503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8091ea-3f56-4025-a3ab-a010318faed7 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.589020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8091ea-3f56-4025-a3ab-a010318faed7 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.589458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8091ea-3f56-4025-a3ab-a010318faed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.605409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a82c51d7f1546969eaa486284dece57', 'request_id': 'req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.615395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a82c51d7f1546969eaa486284dece57', 'request_id': 'req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.630754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8d8091ea-3f56-4025-a3ab-a010318faed7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:00.632022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8d8091ea-3f56-4025-a3ab-a010318faed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:00.645330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a82c51d7f1546969eaa486284dece57', 'request_id': 'req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.674039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] The token cache is being invalidate because project 5a82c51d7f1546969eaa486284dece57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:00.674039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.674727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.676744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1147/2280] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:00 2022] DELETE /identity/v3/projects/5a82c51d7f1546969eaa486284dece57 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:00.680334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:00.684877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:00.752649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1134/2281] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:00.761722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.762007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.762279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.802470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0ebc3-7c67-46ec-8b4f-1ce8cd569694 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:00.815393 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:00.816655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:00.817746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:00.818420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.818700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.819130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] PATH_INFO: `/v3/users/0a6630276abc4e119a7dc12596700de3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.821138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6630276abc4e119a7dc12596700de3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:00.823121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:00.843843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1135/2282] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:00.846220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:00.867759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71192013-a8b5-46d6-8ec7-9da714ed1e96 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:00.878188 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:00.878819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.879678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.879993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.881496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:00.881819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:00.884171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:00.947097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1136/2283] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:15:00.955285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:00.955594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6630276abc4e119a7dc12596700de3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.955594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6630276abc4e119a7dc12596700de3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.955594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6630276abc4e119a7dc12596700de3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.972257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf1af-9624-46c6-8496-45dc7cd65fba admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:00.975008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6630276abc4e119a7dc12596700de3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.989524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6630276abc4e119a7dc12596700de3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:00.993091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:00.994011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:00.994295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:00.994563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:00.995219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:00.997161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.016384 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1148/2284] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:00 2022] DELETE /identity/v3/users/0a6630276abc4e119a7dc12596700de3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:01.066338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1137/2285] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:00 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:01.067720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.069594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:01.123659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:01.193668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979fb4-4e0c-4c1e-8058-d6d72636ba5e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.335541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.336260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.336603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.337066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.339130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.342071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.381905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1149/2286] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:01 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:01.391068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.404033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad68532-10d2-4a0b-ad24-42ff8a07b901 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.425048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.425912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.428502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.429106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.451003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.452945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.475746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1138/2287] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:01.480262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.493156 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56188de-a20c-4c4f-b8ed-42dd1f876894 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.499910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.500540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.500816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.501085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.502311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.504048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126b039-c0a8-4646-848f-c074d968bb98 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.526571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1150/2288] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:15:01.540305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.558438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023b50-6015-4556-993d-cb758c9bab6e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.569614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.570627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.572308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.572792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] PATH_INFO: `/v3/projects/58ae386252884981a577a1dd14d56b2a/users/50a554ad04cd480bb15cbf5e8ca48b1c/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.611088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ae386252884981a577a1dd14d56b2a, user_id=50a554ad04cd480bb15cbf5e8ca48b1c, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.611088 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.646447 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1139/2289] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:01 2022] PUT /identity/v3/projects/58ae386252884981a577a1dd14d56b2a/users/50a554ad04cd480bb15cbf5e8ca48b1c/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:01.657219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.657655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.658025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.703427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.705350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:01.725835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] MFA Rules not processed for user `50a554ad04cd480bb15cbf5e8ca48b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:01.727370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:01.777047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:01.840771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1151/2290] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:01.849379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:01.850008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:01.856057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609628-c38d-4c9e-af2b-4b54e128e663 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.878191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.879611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.880387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.881645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] PATH_INFO: `/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.893976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17da24cc8e2e4b01b8ee66fea3b5e484)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.896055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.931484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:01.945042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427cb47-8e2b-478f-ae7d-45c59baa0110 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:01.950390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:01.951068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:01.951381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:01.951649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:01.962986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:01.964899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36f91a-3b95-4c7b-ab29-f8b58dfed951 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:01.976295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1152/2291] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:15:01.983458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17da24cc8e2e4b01b8ee66fea3b5e484', 'request_id': 'req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:01.993567 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17da24cc8e2e4b01b8ee66fea3b5e484', 'request_id': 'req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:02.000530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17da24cc8e2e4b01b8ee66fea3b5e484', 'request_id': 'req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:02.019223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] The token cache is being invalidate because project 17da24cc8e2e4b01b8ee66fea3b5e484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:02.019529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:02.020390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-02f4b2f1-e209-43ca-9390-78f5bb9d34a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:02.022496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1140/2292] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:01 2022] DELETE /identity/v3/projects/17da24cc8e2e4b01b8ee66fea3b5e484 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:15:02.028077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.028397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.028641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.058103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:02.059840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:02.138346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1153/2293] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:02.146122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.146404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.146675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.181758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:02.183091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:02.198468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1141/2294] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:02.200114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.211053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3debf-53b9-4ba4-8d8b-28bb8618b617 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.217143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.218374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.218682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.219166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.221802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:02.222218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.223982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.240711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1154/2295] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:15:02.242251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.254874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd0364-3d1a-489e-b12e-70e8c628a821 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.260968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.261620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.262059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.262395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.263822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.266432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.315391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1142/2296] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:02 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:02.317266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.342373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007eda-5a35-48ce-8e4b-ed34851a7b5f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.430102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.430888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.431165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.431467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.432092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.434031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.472596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1155/2297] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:02 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:02.474113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.487343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44333cda-6ffe-4698-a326-bd763d6d76cb admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.508460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.509485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.509632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.509844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.511686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.513380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.531227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1143/2298] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:02.533435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.545821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bff0a9-6074-4e6f-9f6e-b9d71685e70f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.551717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.552725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.553315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.553681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.557507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.559607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fef5b-0ecf-4234-8d6d-bc5746025cd1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.581956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1156/2299] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:02.585871 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.605824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e053-5d0e-4575-9a7c-a970e433a163 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:02.622930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:02.623653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.623928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.624199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] PATH_INFO: `/v3/projects/df35e4858d5d437faa480b4ce07cff17/users/3c88c6734fc84f95b5516028992596a7/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.643773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df35e4858d5d437faa480b4ce07cff17, user_id=3c88c6734fc84f95b5516028992596a7, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:02.654924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:02.694848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1144/2300] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:02 2022] PUT /identity/v3/projects/df35e4858d5d437faa480b4ce07cff17/users/3c88c6734fc84f95b5516028992596a7/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:02.698241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:02.698795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:02.699370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:02.732367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] MFA Rules not processed for user `3c88c6734fc84f95b5516028992596a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:02.733777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:02.788629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:02.822720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1157/2301] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:02.838159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:02.840355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:03.016285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f771fa3-02e6-42f4-96a3-b687b91653a8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:03.028476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:03.029119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:03.029488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:03.029967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:03.053767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:03.055305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04385378-e9d6-4ad1-a983-34e0218c4114 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:03.062927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:03.094572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1145/2302] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:03.230321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:03.234149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:03.252950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f7e4-93b9-4e6b-b8b3-30e51af294a8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:03.257591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:03.259514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:03.259514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:03.260597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:03.264494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:03.359966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:03.362391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747a403-84a9-4c98-ac4d-bc4cea63727e service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:03.376161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1158/2303] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:03.541689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:03.541689 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:03.542144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:03.569257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] MFA Rules not processed for user `50a554ad04cd480bb15cbf5e8ca48b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:03.570505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:03.637324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1146/2304] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:04.150683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38a-6474-4a74-bf36-26fcc4f47cac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:04.151219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38a-6474-4a74-bf36-26fcc4f47cac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:04.151219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aca38a-6474-4a74-bf36-26fcc4f47cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:04.191841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c0aca38a-6474-4a74-bf36-26fcc4f47cac None None] MFA Rules not processed for user `4b7f6d085f89478db97ef7da015932ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:04.194343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c0aca38a-6474-4a74-bf36-26fcc4f47cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:04.318155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1159/2305] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:04.406615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:04.409051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:04.550043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d163-fd87-436c-a3b0-c3decc7a3503 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:04.560777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:04.561476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:04.561808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:04.562122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:04.588177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:04.589129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:04.616134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1147/2306] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:06.357841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcedbd4-fc58-47c2-9481-1c67b6848736 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:06.358931 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcedbd4-fc58-47c2-9481-1c67b6848736 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:06.359203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcedbd4-fc58-47c2-9481-1c67b6848736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:06.378932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2dcedbd4-fc58-47c2-9481-1c67b6848736 None None] MFA Rules not processed for user `4b7f6d085f89478db97ef7da015932ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:06.380245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2dcedbd4-fc58-47c2-9481-1c67b6848736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:06.388541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1160/2307] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:14.599851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=60 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:16.380259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=74 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:25.688601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:25.690314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:25.775038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701653-9eea-463e-a3f6-c00ab9f40fb1 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:25.780927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:25.781749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:25.782129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:25.782598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] PATH_INFO: `/v3/users/d17b75fd61814b79b81dcaea46d9949f` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:25.783935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17b75fd61814b79b81dcaea46d9949f)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:25.785902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:25.843633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17b75fd61814b79b81dcaea46d9949f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:25.853179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17b75fd61814b79b81dcaea46d9949f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:25.861193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17b75fd61814b79b81dcaea46d9949f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:25.862173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17b75fd61814b79b81dcaea46d9949f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:25.878914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17b75fd61814b79b81dcaea46d9949f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:25.885364 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1148/2308] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:25 2022] DELETE /identity/v3/users/d17b75fd61814b79b81dcaea46d9949f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:25.890027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:25.890561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:25.890561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:25.911592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:25.912804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:25.974335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1161/2309] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:25.984394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:25.986055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:26.071036 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f29d-bf21-418f-bc1b-4c2b449e37ae admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:26.074708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:26.075362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.075646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.075942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.085876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:26.087549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4974b-f04d-4336-bad3-4ef8b4c6528c service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:26.097150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1149/2310] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:26.631339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:26.633322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:26.648660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14758b-55aa-4570-a9e5-c3e26e3704cb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:26.655032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:26.655739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.656057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.656280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] PATH_INFO: `/v3/projects/30be0080223a4df7974c994bec589e1c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.657523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30be0080223a4df7974c994bec589e1c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:26.660815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:26.715476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30be0080223a4df7974c994bec589e1c', 'request_id': 'req-afa9b4b1-a927-4f66-b6b8-598af8240c0b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:26.722830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30be0080223a4df7974c994bec589e1c', 'request_id': 'req-afa9b4b1-a927-4f66-b6b8-598af8240c0b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:26.730484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30be0080223a4df7974c994bec589e1c', 'request_id': 'req-afa9b4b1-a927-4f66-b6b8-598af8240c0b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:26.741312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] The token cache is being invalidate because project 30be0080223a4df7974c994bec589e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:26.741627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:26.742329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-afa9b4b1-a927-4f66-b6b8-598af8240c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:26.743988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1162/2311] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:26 2022] DELETE /identity/v3/projects/30be0080223a4df7974c994bec589e1c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:26.749380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.749921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.749921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.770762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:26.772043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:26.790407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:26.836910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1150/2312] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:26.844600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.844934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.845213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.870214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:26.872114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:26.882130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1163/2313] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:26.885672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:26.895969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767aff5-2034-41ff-bd27-ff168d6a6984 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:26.901674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:26.902524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.903099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.903541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.904395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:26.904865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:26.906717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:26.919214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1151/2314] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:15:26.923684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:26.936749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84a5be-2dba-4ea1-8180-b1182855eb1f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:26.941508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:26.942126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:26.942406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:26.942680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:26.943348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:26.945259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:26.981159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1164/2315] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:26 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:26.982924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:26.994114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27754ee-14b9-40ae-bdb7-6e4d758f314e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:27.060318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:27.060941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.061223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.061500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.062142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:27.064356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:27.094161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1152/2316] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:26 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:27.098240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:27.109359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2e42-3b21-494f-a094-23e3db55092c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:27.114772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:27.115608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.116116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.116601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.117765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:27.123671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:27.138666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1165/2317] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:27.139599 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:27.153874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b599d3d-874e-4489-9884-b6b905bab9da admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:27.159125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:27.159780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.160055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.160329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.161553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:27.162717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadaac7-2d0c-444a-8a60-fc3ab5681d11 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:27.180399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1153/2318] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:27.183453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:27.196070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81036-850c-41ea-83bd-ae0d74da8ca3 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:27.202221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:27.203430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.203941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.204597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] PATH_INFO: `/v3/projects/20a40c3551c84024bc348658519a1213/users/eff7dbf8f95640859304241af8aa94f2/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.223112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a40c3551c84024bc348658519a1213, user_id=eff7dbf8f95640859304241af8aa94f2, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:27.226162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:27.269312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1166/2319] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:27 2022] PUT /identity/v3/projects/20a40c3551c84024bc348658519a1213/users/eff7dbf8f95640859304241af8aa94f2/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:27.269508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.269508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.269508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.320435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] MFA Rules not processed for user `eff7dbf8f95640859304241af8aa94f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:27.321685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:27.412804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1154/2320] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:27.426375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:27.428140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:27.456164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:27.505682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735c99-e5b4-4478-9926-36088f246bbd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:27.509579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:27.510338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:27.510606 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:27.510896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:27.522902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:27.524413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:27.563216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1167/2321] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:28.788375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:28.794335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:28.816960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:28.880415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba8ff-2b7c-4e82-9d0a-2f96c04a150c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:28.886140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:28.886861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:28.887147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:28.887470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] PATH_INFO: `/v3/users/15a7df6befeb4954a7af83dcf8764920` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:28.888775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a7df6befeb4954a7af83dcf8764920)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:28.891296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:29.009431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a7df6befeb4954a7af83dcf8764920'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.024843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a7df6befeb4954a7af83dcf8764920'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.033609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a7df6befeb4954a7af83dcf8764920'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.034539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a7df6befeb4954a7af83dcf8764920'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.052945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a7df6befeb4954a7af83dcf8764920'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.059449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1155/2322] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:28 2022] DELETE /identity/v3/users/15a7df6befeb4954a7af83dcf8764920 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:29.315031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:29.335854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c52b-6421-4835-a3b0-cc96e3a1faab service glance] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:29.405301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:29.406043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:29.406382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:29.406719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] PATH_INFO: `/v3/projects/e5b621743b5847248ca3ac7492d4f338` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:29.408086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b621743b5847248ca3ac7492d4f338)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:29.410115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:29.462086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b621743b5847248ca3ac7492d4f338', 'request_id': 'req-0815da8f-0fd3-4427-a250-2603a00777b0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.469436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b621743b5847248ca3ac7492d4f338', 'request_id': 'req-0815da8f-0fd3-4427-a250-2603a00777b0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.480137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b621743b5847248ca3ac7492d4f338', 'request_id': 'req-0815da8f-0fd3-4427-a250-2603a00777b0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.492993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] The token cache is being invalidate because project e5b621743b5847248ca3ac7492d4f338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:29.493282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.494005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.495636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1168/2323] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:29 2022] DELETE /identity/v3/projects/e5b621743b5847248ca3ac7492d4f338 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:29.499699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:29.501324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:29.514961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a386-a704-4317-ba4a-74c275fc831d admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:29.584250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:29.584790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:29.585070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:29.585349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] PATH_INFO: `/v3/users/95bc275d19454f8bbd91608d40a51bfa` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:29.586510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bc275d19454f8bbd91608d40a51bfa)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:29.588496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:29.646481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:29.664079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bc275d19454f8bbd91608d40a51bfa'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.678523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bc275d19454f8bbd91608d40a51bfa'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.690230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bc275d19454f8bbd91608d40a51bfa'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.691023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bc275d19454f8bbd91608d40a51bfa'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.709320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5fa2430f-13c7-4849-9bec-68a349583743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bc275d19454f8bbd91608d40a51bfa'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:29.715762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1156/2324] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:29 2022] DELETE /identity/v3/users/95bc275d19454f8bbd91608d40a51bfa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:29.908660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:29.915098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:29.933338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815da8f-0fd3-4427-a250-2603a00777b0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:29.994159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:30.005302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.006362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.006686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.007252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] PATH_INFO: `/v3/projects/a663daf6c9a641978d69f05b23ee6a50` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.008413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a663daf6c9a641978d69f05b23ee6a50)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.010382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.068035 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a663daf6c9a641978d69f05b23ee6a50', 'request_id': 'req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:30.081231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a663daf6c9a641978d69f05b23ee6a50', 'request_id': 'req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:30.097080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a663daf6c9a641978d69f05b23ee6a50', 'request_id': 'req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:30.116400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] The token cache is being invalidate because project a663daf6c9a641978d69f05b23ee6a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:30.116732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:30.117358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ce3c9271-9f35-47e7-8ea5-c55922dd54e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:30.119289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1169/2325] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:29 2022] DELETE /identity/v3/projects/a663daf6c9a641978d69f05b23ee6a50 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:30.123949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.124429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.124561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.144754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:30.146002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:30.226745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1157/2326] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:30.237624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.238369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.238742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.265360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:30.266713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:30.275698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1170/2327] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:30.280181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.290576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ea10-2bef-48e6-9170-5e8e5d3bdbd6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.295440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.296079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.296388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.296653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.297499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:30.297829 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.299512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.316434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1158/2328] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:15:30.321103 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.331408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b583c-0697-430b-a10d-29f019fcaa09 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.336817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.337448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.337721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.337985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.338635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.340589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.374032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1171/2329] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:30.378451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.394773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02431-7a27-4052-bb3a-810e9187f6ff admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.460237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.461255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.462428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.462992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.463861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.466059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.499257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1159/2330] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:30 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:30.501051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.522984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476b8f6-e801-44a2-a3f3-acfff4eb3c87 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.529853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.530496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.530948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.531253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.531909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.533558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.562229 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1172/2331] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:30.566262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.579269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fef6e6-75f0-4396-8b3e-fc73dc460c21 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.584591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.585211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.585488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.585754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.586616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.588056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a55700-b95d-491f-a650-c93546c239b1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.606498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1160/2332] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:30.610743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.630305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7435-9b7d-48aa-bd27-ea4340ed8f5e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.640191 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.640911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.641188 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.641599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] PATH_INFO: `/v3/projects/f452a37288854d2888ea7f59df0ade67/users/aead8b808f4d477c82a70675cb4054ef/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.660184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f452a37288854d2888ea7f59df0ade67, user_id=aead8b808f4d477c82a70675cb4054ef, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.663101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.691505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1173/2333] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:30 2022] PUT /identity/v3/projects/f452a37288854d2888ea7f59df0ade67/users/aead8b808f4d477c82a70675cb4054ef/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:30.699267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.699743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.700193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.739112 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] MFA Rules not processed for user `aead8b808f4d477c82a70675cb4054ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:30.740497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:30.752440 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:30.850060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1161/2334] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:30.860806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:30.862787 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:30.926571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606983b-ce91-43b8-aae7-df245a706783 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:30.930245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:30.930883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:30.931336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:30.931610 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:30.941297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:30.942741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abc2f-03f6-446a-82d1-6e5eb038488f service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:30.952531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1174/2335] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:33.621253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:33.691301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fb07e-6b1c-4651-89e9-71ead63e785a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:33.696058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:33.696692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:33.696974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:33.697248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] PATH_INFO: `/v3/users/aead8b808f4d477c82a70675cb4054ef` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:33.698486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aead8b808f4d477c82a70675cb4054ef)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:33.700679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:33.757869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aead8b808f4d477c82a70675cb4054ef'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:33.768329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aead8b808f4d477c82a70675cb4054ef'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:33.780383 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aead8b808f4d477c82a70675cb4054ef'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:33.781162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aead8b808f4d477c82a70675cb4054ef'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:33.794011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aead8b808f4d477c82a70675cb4054ef'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:33.800245 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1162/2336] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:33 2022] DELETE /identity/v3/users/aead8b808f4d477c82a70675cb4054ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:33.805064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:33.805570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:33.805664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:33.826263 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:33.827525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:33.844837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:33.893613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1175/2337] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:33.904224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:33.906029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:33.943927 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:33.972183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe241-1da6-490f-ac0b-8a13129ddbb3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:33.978297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:33.978944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:33.979288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:33.979593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:33.990079 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:33.991635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b720e7-36ec-4408-b044-1c553af58351 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.001640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1163/2338] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:34.288845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.290472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:34.304601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f077d3-34bf-471a-ae05-43b60626fcd5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.310552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.311239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.311499 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.311875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] PATH_INFO: `/v3/projects/f452a37288854d2888ea7f59df0ade67` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.313110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f452a37288854d2888ea7f59df0ade67)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.315040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.372550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f452a37288854d2888ea7f59df0ade67', 'request_id': 'req-13dbc587-a56a-41da-827e-15e1c8160e99'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:34.382642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f452a37288854d2888ea7f59df0ade67', 'request_id': 'req-13dbc587-a56a-41da-827e-15e1c8160e99'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:34.394518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f452a37288854d2888ea7f59df0ade67', 'request_id': 'req-13dbc587-a56a-41da-827e-15e1c8160e99'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:34.408468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] The token cache is being invalidate because project f452a37288854d2888ea7f59df0ade67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:34.408751 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:34.409489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-13dbc587-a56a-41da-827e-15e1c8160e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:34.411150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1176/2339] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:34 2022] DELETE /identity/v3/projects/f452a37288854d2888ea7f59df0ade67 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:34.416858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.417194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.417404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.438288 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:34.439678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:34.503535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1164/2340] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:34.513375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.513662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.513948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.537447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:34.538696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:34.546699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1177/2341] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:34.551336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.562790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9ec18-bc9f-4c28-ac86-b322a7757a77 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.573563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.573563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.573563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.573563 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.574114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:34.574114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.574114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.586050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1165/2342] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:15:34.590592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.602409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528b98-b0c6-4a82-819c-37c0f146cbd7 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.608525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.609136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.609411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.609679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.610307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.612316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.654523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1178/2343] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:34 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:34.663950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.675712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf1335-c67b-4083-beb1-db927a98fe13 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.745539 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.746224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.746524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.746803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.747523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.749514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.774783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1166/2344] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:34 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:34.777809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.788361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83215a-5511-4eb6-b405-dfbb4fb510dd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.793084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.793681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.793938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.794203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.794844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.796459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.807772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1179/2345] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:34.812145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.823529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b00b-9aff-41bd-a992-ecf7ecbb7bfb admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.828363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.829541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.829541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.829541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.830133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.831813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d39f7d-c9fa-4be7-bdc6-6873e89f0253 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.846515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1167/2346] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:34.850819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:34.860850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295546f8-4206-41e4-9073-9878a903ff37 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:34.865736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:34.866401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.866682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.866920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] PATH_INFO: `/v3/projects/8f419db83f604c2b8247f9eb88bf4798/users/9048270267064beab1462c9b5c06d87e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.882426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f419db83f604c2b8247f9eb88bf4798, user_id=9048270267064beab1462c9b5c06d87e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:34.885116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:34.904074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1180/2347] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:34 2022] PUT /identity/v3/projects/8f419db83f604c2b8247f9eb88bf4798/users/9048270267064beab1462c9b5c06d87e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:34.922285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:34.922585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:34.922860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:34.951968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] MFA Rules not processed for user `9048270267064beab1462c9b5c06d87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:34.953199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:34.995221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:35.034348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1168/2348] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:35.045871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:35.047679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:35.098792 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:35.112366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483112e0-6bd5-46be-a6ed-6a8992f95410 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:35.116088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:35.116694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.116965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.117230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.125956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:35.127410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f441-f92b-43eb-8737-639e6aec6ea2 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:35.138826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1181/2349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:35.169471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:35.239174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a69ad-04dd-4400-a918-c78ce7080f12 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:35.244733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:35.245386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.245662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.245939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] PATH_INFO: `/v3/users/9048270267064beab1462c9b5c06d87e` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.247243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9048270267064beab1462c9b5c06d87e)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:35.249256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:35.305423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9048270267064beab1462c9b5c06d87e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.316807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9048270267064beab1462c9b5c06d87e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.326896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9048270267064beab1462c9b5c06d87e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.327878 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9048270267064beab1462c9b5c06d87e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.341475 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9048270267064beab1462c9b5c06d87e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.347825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1169/2350] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:35 2022] DELETE /identity/v3/users/9048270267064beab1462c9b5c06d87e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:35.352665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.352947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.353200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.374445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:35.376010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:35.438873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1182/2351] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:35.449630 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:35.451990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:35.510915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:35.515497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909a0ac-38a6-4312-9d5d-4998a49309f2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:35.521002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:35.521622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.521939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.522186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.533275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:35.534794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9755-74b4-4da2-8934-0bdf15c0c67b service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:35.544678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1170/2352] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:35.833580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:35.835746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:35.848783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ba22-6fd5-4e99-8a2e-e076f26c9c93 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:35.854171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:35.854813 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.855086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.855395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] PATH_INFO: `/v3/projects/8f419db83f604c2b8247f9eb88bf4798` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.856572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f419db83f604c2b8247f9eb88bf4798)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:35.858694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:35.914475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f419db83f604c2b8247f9eb88bf4798', 'request_id': 'req-ef90824a-cbb2-4916-a180-968f5824c8db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.921278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f419db83f604c2b8247f9eb88bf4798', 'request_id': 'req-ef90824a-cbb2-4916-a180-968f5824c8db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.930086 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f419db83f604c2b8247f9eb88bf4798', 'request_id': 'req-ef90824a-cbb2-4916-a180-968f5824c8db'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.940525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] The token cache is being invalidate because project 8f419db83f604c2b8247f9eb88bf4798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:35.940798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.941429 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ef90824a-cbb2-4916-a180-968f5824c8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:35.942946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1183/2353] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:35 2022] DELETE /identity/v3/projects/8f419db83f604c2b8247f9eb88bf4798 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:35.948007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:35.948519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:35.948519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:35.969374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:35.970607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:36.036434 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1171/2354] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:36.044329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.044749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.045066 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.072148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:36.073468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:36.083443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1184/2355] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:15:36.092479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.102579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ecc5-8717-4d19-90f4-9919e1b9b951 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.110312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.110989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.111394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.111691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.112345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:15:36.112650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.114465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.126750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1172/2356] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:15:36.131116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.140447 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c376d64-83a9-413a-951f-83c21a5ad435 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.145150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.145763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.146041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.146309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.146937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.149039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.181909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1185/2357] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:15:36 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:36.186019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.195868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a896b-a08f-4229-8b4c-4ef83573b5b7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.263980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.264615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.264902 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.265225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.265828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.268059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.292547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1173/2358] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:15:36 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:15:36.296721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.307598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca95b-1860-46f3-98c4-4d1d215bcf04 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.313234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.313870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.314235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.314507 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.315175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.316961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.328501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1186/2359] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:36.333493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.348379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f90802-bf23-44ab-ae3c-9c04b248bc06 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.356180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.357167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.357474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.357930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.358836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.360536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebd551-5799-4dc1-83d8-8a9d5a805a28 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.372421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1174/2360] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:15:36.377043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.387742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11e21-ab05-4ef2-98f4-44f779aa9f0e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.393093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.393742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.394020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.394290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] PATH_INFO: `/v3/projects/41eef7e258ab47c9b6255acc6f9f34fd/users/88f149665de44da288235cf80f3c58d3/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.410264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41eef7e258ab47c9b6255acc6f9f34fd, user_id=88f149665de44da288235cf80f3c58d3, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.413531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.429488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1187/2361] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:15:36 2022] PUT /identity/v3/projects/41eef7e258ab47c9b6255acc6f9f34fd/users/88f149665de44da288235cf80f3c58d3/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:36.434621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeea02-fb6c-4e08-81f5-5e83bbe6b5e2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.434900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeea02-fb6c-4e08-81f5-5e83bbe6b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.435169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeea02-fb6c-4e08-81f5-5e83bbe6b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.457512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6caeea02-fb6c-4e08-81f5-5e83bbe6b5e2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:36.458724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6caeea02-fb6c-4e08-81f5-5e83bbe6b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:36.509839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:36.520173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1175/2362] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:36.530382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:36.532464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:36.539772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:36.594757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9afa6-9534-4eb4-bad4-9ec8788f1031 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:36.598759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:36.599414 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.599687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.599954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.609556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:36.611144 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:36.623957 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1188/2363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:36.839495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f186-511f-4170-978e-ddb087d19937 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:36.839782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f186-511f-4170-978e-ddb087d19937 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:36.840058 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f186-511f-4170-978e-ddb087d19937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:36.860135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-4ce5f186-511f-4170-978e-ddb087d19937 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:36.861431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4ce5f186-511f-4170-978e-ddb087d19937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:36.960227 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1176/2364] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:15:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:37.007106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:37.008632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:37.090761 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e785014-169d-4b99-a60f-2aa9585c1ed3 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:37.095934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:37.097706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:37.097706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:37.097706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:37.106952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:37.108923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:37.120090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1189/2365] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:15:37.377180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cbc37-f4b7-4495-a4d7-ff194393c24c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:37.377374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cbc37-f4b7-4495-a4d7-ff194393c24c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:37.377629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cbc37-f4b7-4495-a4d7-ff194393c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:37.419118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-711cbc37-f4b7-4495-a4d7-ff194393c24c None None] MFA Rules not processed for user `88f149665de44da288235cf80f3c58d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:37.420438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-711cbc37-f4b7-4495-a4d7-ff194393c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:37.514122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1177/2366] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:37.525631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:37.527057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:37.586776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022ad3-ec9e-48ac-9c3c-472cc95de08b service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:37.590993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:37.591711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:37.592054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:37.592389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:37.601909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:37.603591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:37.616671 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1190/2367] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:37.790419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779be6-5def-4557-8b05-e5354aa8e1cf None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:37.790803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779be6-5def-4557-8b05-e5354aa8e1cf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:37.791278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779be6-5def-4557-8b05-e5354aa8e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:37.812277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9c779be6-5def-4557-8b05-e5354aa8e1cf None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:37.813735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9c779be6-5def-4557-8b05-e5354aa8e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:37.822046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1178/2368] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:37.836068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:37.849696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038dca7-ba9b-4773-936d-4e9109db2fe3 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:37.855653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:37.856359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:37.856683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:37.857040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:37.866915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:37.868765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:37.880972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1191/2369] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:15:38.123964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24329-e8fb-4e97-97c3-3c19c0c78072 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:38.124462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24329-e8fb-4e97-97c3-3c19c0c78072 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:38.124555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24329-e8fb-4e97-97c3-3c19c0c78072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:38.150086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d4e24329-e8fb-4e97-97c3-3c19c0c78072 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:38.151255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d4e24329-e8fb-4e97-97c3-3c19c0c78072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:38.159339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1179/2370] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:38.171773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:38.182658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66124b-c2a1-439a-8c03-c9c73618a6ad service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:38.188821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:38.189430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:38.189799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:38.190040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:38.198520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:38.200114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:38.210342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1192/2371] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:15:38.578031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbb27-4465-4919-8b42-ec3191e08ccf None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:38.578399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbb27-4465-4919-8b42-ec3191e08ccf None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:38.578748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dbb27-4465-4919-8b42-ec3191e08ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:38.598220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c35dbb27-4465-4919-8b42-ec3191e08ccf None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:38.599575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c35dbb27-4465-4919-8b42-ec3191e08ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:38.606719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1180/2372] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:38.620856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:38.631437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031bdf7-d8b6-4705-818d-3f2099627661 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:38.636899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:38.637508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:38.637784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:38.638055 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:38.646573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:38.648181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:38.653072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:38.657214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1193/2373] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:15:40.068697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9b34-72ba-4388-8d62-7c6a36da0560 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:40.069248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9b34-72ba-4388-8d62-7c6a36da0560 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:40.069248 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9b34-72ba-4388-8d62-7c6a36da0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:40.088431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2c3c9b34-72ba-4388-8d62-7c6a36da0560 None None] MFA Rules not processed for user `88f149665de44da288235cf80f3c58d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:40.089627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2c3c9b34-72ba-4388-8d62-7c6a36da0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:40.096964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1181/2374] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:40.822839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:40.824542 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:40.839276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde35e-132a-4901-aacb-1a7ccc42b115 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:40.844763 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:40.845464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:40.845936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:40.846190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] PATH_INFO: `/v3/users/50a554ad04cd480bb15cbf5e8ca48b1c` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:40.847402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a554ad04cd480bb15cbf5e8ca48b1c)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:40.849993 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:40.914698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a554ad04cd480bb15cbf5e8ca48b1c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:40.915703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a554ad04cd480bb15cbf5e8ca48b1c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:40.916303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a554ad04cd480bb15cbf5e8ca48b1c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:40.931822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a554ad04cd480bb15cbf5e8ca48b1c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:40.941249 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a554ad04cd480bb15cbf5e8ca48b1c'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:40.965772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1194/2375] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:40 2022] DELETE /identity/v3/users/50a554ad04cd480bb15cbf5e8ca48b1c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:40.970253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:40.970893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:40.971208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:40.997355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:40.998827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:41.082607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1182/2376] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:41.089267 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:41.090840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:41.156303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab4e8-c847-40c6-81f5-c2b065d53fb0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:41.160007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:41.160613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:41.160886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:41.161155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:41.169846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:41.171305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:41.180668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1195/2377] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:41.365817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:41.367363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:41.383958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b3861-1e55-4e47-b66a-5524ce30d870 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:41.389741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:41.390505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:41.390791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:41.391057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] PATH_INFO: `/v3/projects/58ae386252884981a577a1dd14d56b2a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:41.392412 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ae386252884981a577a1dd14d56b2a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:41.394353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:41.396043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:41.448422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ae386252884981a577a1dd14d56b2a', 'request_id': 'req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:41.454901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ae386252884981a577a1dd14d56b2a', 'request_id': 'req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:41.461306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ae386252884981a577a1dd14d56b2a', 'request_id': 'req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:41.478348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] The token cache is being invalidate because project 58ae386252884981a577a1dd14d56b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:41.479308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:41.480001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-2dfa450c-f5a4-4833-890e-ae52c8fbaa44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:41.481612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1183/2378] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:41 2022] DELETE /identity/v3/projects/58ae386252884981a577a1dd14d56b2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:51.176514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:51.475551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:15:53.883486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:53.885075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:53.898754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a143-5a7b-44a5-94a4-496008b488a4 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:53.956860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:53.957501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:53.957774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:53.958042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] PATH_INFO: `/v3/users/3c88c6734fc84f95b5516028992596a7` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:53.959202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c88c6734fc84f95b5516028992596a7)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:53.961165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:54.012935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c88c6734fc84f95b5516028992596a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.013468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c88c6734fc84f95b5516028992596a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.014073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c88c6734fc84f95b5516028992596a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.023512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c88c6734fc84f95b5516028992596a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.030711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c88c6734fc84f95b5516028992596a7'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.049134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1196/2379] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:15:53 2022] DELETE /identity/v3/users/3c88c6734fc84f95b5516028992596a7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:15:54.053666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:54.054170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:54.054271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:54.075076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:15:54.076581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:54.144523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1184/2380] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:15:54.155130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:54.156621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:54.216381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920eba-ca4d-426f-88fd-799b1f287e2e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:54.220805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:54.221464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:54.221744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:54.222011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:54.231109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:54.232548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05817300-2e28-44c6-a200-dd5726c59f96 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:54.241926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1197/2381] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:15:54.542751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:15:54.544275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:15:54.556718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172912f-cf81-4b0e-a1f2-e5077e525e6b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:15:54.562551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:15:54.563531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:15:54.563531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:15:54.563797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] PATH_INFO: `/v3/projects/df35e4858d5d437faa480b4ce07cff17` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:15:54.565008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df35e4858d5d437faa480b4ce07cff17)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:15:54.566940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:15:54.618553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df35e4858d5d437faa480b4ce07cff17', 'request_id': 'req-0951c7c0-c81d-44fb-b307-0619b4d1e791'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.624923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df35e4858d5d437faa480b4ce07cff17', 'request_id': 'req-0951c7c0-c81d-44fb-b307-0619b4d1e791'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.630838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df35e4858d5d437faa480b4ce07cff17', 'request_id': 'req-0951c7c0-c81d-44fb-b307-0619b4d1e791'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.646949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] The token cache is being invalidate because project df35e4858d5d437faa480b4ce07cff17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:15:54.647258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.647900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:15:54.649877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1185/2382] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:15:54 2022] DELETE /identity/v3/projects/df35e4858d5d437faa480b4ce07cff17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:16:03.217991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2935f-06ae-4642-89bd-c63a136f08dd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:03.218487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2935f-06ae-4642-89bd-c63a136f08dd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:03.218662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2935f-06ae-4642-89bd-c63a136f08dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:03.239812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b7f2935f-06ae-4642-89bd-c63a136f08dd None None] MFA Rules not processed for user `72f072c5cd5d43538aa0106eee042559`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:03.240991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b7f2935f-06ae-4642-89bd-c63a136f08dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:03.252167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:03.254234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:03.262316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:03.307540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1198/2383] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:16:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:03.329452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c7c0-c81d-44fb-b307-0619b4d1e791 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:03.336867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:03.337598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:03.337872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:03.338143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] PATH_INFO: `/v3/users/eff7dbf8f95640859304241af8aa94f2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:03.339284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff7dbf8f95640859304241af8aa94f2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:03.341237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:03.374851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:03.397780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff7dbf8f95640859304241af8aa94f2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:03.407912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff7dbf8f95640859304241af8aa94f2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:03.415124 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff7dbf8f95640859304241af8aa94f2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:03.416560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff7dbf8f95640859304241af8aa94f2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:03.432173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff7dbf8f95640859304241af8aa94f2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:03.438314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1186/2384] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:16:03 2022] DELETE /identity/v3/users/eff7dbf8f95640859304241af8aa94f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:16:03.442796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:03.443084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:03.443395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:03.463518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:03.464827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:03.530773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1199/2385] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:03.540854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:03.542416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:03.604839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef2f58-6155-44f3-8be1-06f4ec0a66df admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:03.616482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:03.617186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:03.617574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:03.617945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:03.628157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:03.629730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab9f8-f9f8-4fbf-bd9c-3db08f4f634a service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:03.640524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1187/2386] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:03.964488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:03.966195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:03.984956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4824-2597-4283-ba80-fa7a627c573f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:03.990653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:03.992389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:03.992854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:03.993227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] PATH_INFO: `/v3/projects/20a40c3551c84024bc348658519a1213` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:03.996526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a40c3551c84024bc348658519a1213)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:03.998470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:04.073358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a40c3551c84024bc348658519a1213', 'request_id': 'req-3db47a30-4991-4255-83f1-d7d8c46b45f0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:04.079834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a40c3551c84024bc348658519a1213', 'request_id': 'req-3db47a30-4991-4255-83f1-d7d8c46b45f0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:04.088662 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a40c3551c84024bc348658519a1213', 'request_id': 'req-3db47a30-4991-4255-83f1-d7d8c46b45f0'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:04.099710 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] The token cache is being invalidate because project 20a40c3551c84024bc348658519a1213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:16:04.100000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:04.101657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:16:04.103431 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1200/2387] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:16:03 2022] DELETE /identity/v3/projects/20a40c3551c84024bc348658519a1213 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:16:13.636250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:14.096694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:21.102041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682ce4-4d0c-4c27-8aa9-6e30c02cc5c2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:21.107497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682ce4-4d0c-4c27-8aa9-6e30c02cc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:21.107497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682ce4-4d0c-4c27-8aa9-6e30c02cc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:21.126177 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-96682ce4-4d0c-4c27-8aa9-6e30c02cc5c2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:21.127435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-96682ce4-4d0c-4c27-8aa9-6e30c02cc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:21.189925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1188/2388] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:21.220891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:21.222430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:21.298069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47a30-4991-4255-83f1-d7d8c46b45f0 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:21.303949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:21.304546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:21.304817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:21.305091 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:21.313342 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:21.314946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:21.324417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1201/2389] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:26.212677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd748-da28-4a71-96cc-e35adf92e40a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:26.213249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd748-da28-4a71-96cc-e35adf92e40a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:26.213249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd748-da28-4a71-96cc-e35adf92e40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:26.233897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-85cbd748-da28-4a71-96cc-e35adf92e40a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:26.235105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-85cbd748-da28-4a71-96cc-e35adf92e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:26.243739 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1189/2390] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:26.282443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:26.284361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:26.300025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284294b6-52d9-47e5-8338-cb78dd4a78e3 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:26.306443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:26.307040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:26.307349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:26.307598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:26.316652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:26.318234 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:26.328176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1202/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:30.543477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01debca-cfbd-41f3-82fd-82b1aeba0935 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:30.544041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01debca-cfbd-41f3-82fd-82b1aeba0935 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:30.544041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01debca-cfbd-41f3-82fd-82b1aeba0935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:30.565145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c01debca-cfbd-41f3-82fd-82b1aeba0935 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:30.567172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c01debca-cfbd-41f3-82fd-82b1aeba0935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:30.577623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1190/2392] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:30.607067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:30.618929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9205-a9ec-458e-9df6-73b05c152f2e service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:30.624755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:30.625346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:30.625620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:30.625887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:30.634388 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:30.636176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:30.645854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1203/2393] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:34.669951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b307f-323b-49c8-9ce4-9178f84fb5bd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:34.670498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b307f-323b-49c8-9ce4-9178f84fb5bd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:34.670498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b307f-323b-49c8-9ce4-9178f84fb5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:34.692481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ab0b307f-323b-49c8-9ce4-9178f84fb5bd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:34.693709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ab0b307f-323b-49c8-9ce4-9178f84fb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:34.703300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1191/2394] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:34.731693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:34.744658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d096d7-838a-4a7f-a830-c88f28681ef0 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:34.751602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:34.752221 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:34.752498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:34.752769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:34.761832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:34.763397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:34.773038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1204/2395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:39.911686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020b15-d735-4c7b-b39d-543ebd8f432d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:39.912512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020b15-d735-4c7b-b39d-543ebd8f432d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:39.912512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04020b15-d735-4c7b-b39d-543ebd8f432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:39.942273 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-04020b15-d735-4c7b-b39d-543ebd8f432d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:39.943551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-04020b15-d735-4c7b-b39d-543ebd8f432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:39.952845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1192/2396] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:39.975903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:39.990467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d587d-8422-4b62-bbd4-94f9476c54c1 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:39.997904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:39.998520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:39.998801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:39.999101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:40.008677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:40.010258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:40.020552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1205/2397] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:44.136027 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:44.136593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:44.136593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:44.149821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=40 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:44.165970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:44.167219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:44.176329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1193/2398] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:44.197700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:44.203623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=59 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:44.210657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0991ee3-1e70-4a5f-bd68-849f03142a06 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:44.216559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:44.217154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:44.217430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:44.217696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:44.228024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:44.229607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a921e1e-08ea-4e28-a333-b171529a20f7 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:44.240060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1206/2399] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:54.159308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:54.235240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:16:57.504262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:57.505983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:57.579859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5975912-a09f-4fa6-b97a-1ec5dcb7bd57 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:57.588314 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:57.589421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:57.589780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:57.590135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:57.593117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:57.607305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:57.608984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:57.622824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1194/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:16:59.404050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadae3-7183-470c-8e47-4a56f2703019 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:59.404716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadae3-7183-470c-8e47-4a56f2703019 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:59.405053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadae3-7183-470c-8e47-4a56f2703019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:59.426659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-33eadae3-7183-470c-8e47-4a56f2703019 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:16:59.428079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-33eadae3-7183-470c-8e47-4a56f2703019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:59.488473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1207/2401] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:16:59.540861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:16:59.542349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:16:59.614256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53275-57df-4686-b154-39c33a20b3ba service placement] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:16:59.619842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:16:59.620487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:16:59.620764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:16:59.621029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:16:59.630246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:16:59.632041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaefdce-494e-459a-b597-e678876102ba service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:16:59.640145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1195/2402] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:17:02.890026 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56a118-89e4-4c4c-b350-4061b05ca003 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:02.890624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56a118-89e4-4c4c-b350-4061b05ca003 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:02.890852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56a118-89e4-4c4c-b350-4061b05ca003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:02.923478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8d56a118-89e4-4c4c-b350-4061b05ca003 None None] MFA Rules not processed for user `88f149665de44da288235cf80f3c58d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:02.924828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8d56a118-89e4-4c4c-b350-4061b05ca003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:02.986520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1208/2403] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:09.636905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=64 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:12.978800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=50 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:16.088406 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.089369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.089823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.091487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1196/2404] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:17:16.098159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441b9e-56b1-4770-bfbf-038b11280092 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.098703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441b9e-56b1-4770-bfbf-038b11280092 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.098703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22441b9e-56b1-4770-bfbf-038b11280092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.118883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-22441b9e-56b1-4770-bfbf-038b11280092 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:16.120167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-22441b9e-56b1-4770-bfbf-038b11280092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:16.132087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1209/2405] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:16.144299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:16.146023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:16.212773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996049-3a7b-456f-986b-85e504d83aa1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:16.216499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:16.217523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.217523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.217888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.228919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:16.230435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21d840-a48c-4d09-afb6-898918e76e5d service glance] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:16.241547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1197/2406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:16.330668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.331279 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.331551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.332923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1210/2407] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:17:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:17:16.341988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762ebc-a804-480a-8701-254b56b4d367 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.342430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762ebc-a804-480a-8701-254b56b4d367 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.342919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd762ebc-a804-480a-8701-254b56b4d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.372747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-dd762ebc-a804-480a-8701-254b56b4d367 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:16.374660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dd762ebc-a804-480a-8701-254b56b4d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:16.447206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1198/2408] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:16.459230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:16.461374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:16.474963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52146a0-1dba-4488-9a06-2a8ff27fbbad None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:16.478777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:16.479403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.479742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.479941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.487728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:16.489155 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0923cb7-d1fd-4f49-a1e3-035a5c9b1020 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:16.497523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1211/2409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:16.590531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a6e9-229b-404c-b5b5-18975ac602c3 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.590814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a6e9-229b-404c-b5b5-18975ac602c3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.591082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a6e9-229b-404c-b5b5-18975ac602c3 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.592469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1199/2410] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:17:16.598239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe455-3e9b-4596-9c95-ea44d4f560eb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.598554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe455-3e9b-4596-9c95-ea44d4f560eb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.598821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffe455-3e9b-4596-9c95-ea44d4f560eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.619704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3fffe455-3e9b-4596-9c95-ea44d4f560eb None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:16.620908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3fffe455-3e9b-4596-9c95-ea44d4f560eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:16.631203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1212/2411] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:16.643389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a6e9-229b-404c-b5b5-18975ac602c3 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:16.656057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a6e9-229b-404c-b5b5-18975ac602c3 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:16.660126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:16.660725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:16.661001 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:16.661269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:16.671744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:16.673178 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77999d6-1f60-41da-b78c-1d21c42bf9e3 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:16.683702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1200/2412] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:21.011867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:21.012370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:21.012370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:21.034214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] MFA Rules not processed for user `4b7f6d085f89478db97ef7da015932ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:21.035472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:21.094231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1213/2413] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:21.991398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634e73-797f-4b74-823b-40e86ab8b75d None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:21.992151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634e73-797f-4b74-823b-40e86ab8b75d None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:21.992151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49634e73-797f-4b74-823b-40e86ab8b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:22.024158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-49634e73-797f-4b74-823b-40e86ab8b75d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:22.025470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-49634e73-797f-4b74-823b-40e86ab8b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:22.033453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1201/2414] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:22.068362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:22.085687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe640-3f14-4b0e-8889-12982e8f69cb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:22.092256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:22.093109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:22.093392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:22.093649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:22.104539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:22.106181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:22.117419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1214/2415] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:24.367890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa075ec-160a-4ffb-8436-470ff206b811 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:24.368358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa075ec-160a-4ffb-8436-470ff206b811 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:24.368444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa075ec-160a-4ffb-8436-470ff206b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:24.388638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0fa075ec-160a-4ffb-8436-470ff206b811 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:24.389865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0fa075ec-160a-4ffb-8436-470ff206b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:24.397561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1202/2416] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:24.410442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:24.422253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019e668-de4d-4049-9129-d50c502ed681 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:24.427801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:24.428402 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:24.428674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:24.428941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:24.437285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:24.438861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:24.446933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1215/2417] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:17:34.383268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=61 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:34.443770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=49 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:17:40.788318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521ed9-6699-4f2d-a0bf-01b858e9a20a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:40.788918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521ed9-6699-4f2d-a0bf-01b858e9a20a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:40.788918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521ed9-6699-4f2d-a0bf-01b858e9a20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:40.824110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0c521ed9-6699-4f2d-a0bf-01b858e9a20a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:40.826309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0c521ed9-6699-4f2d-a0bf-01b858e9a20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:40.839696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1203/2418] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:40.868693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:40.881577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b1e1-bc47-4fce-8117-17d823fb0e24 service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:40.888467 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:40.889057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:40.889332 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:40.889601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:40.898157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:40.900070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:40.909984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1216/2419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:45.924250 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be469a4-1d6a-49aa-9823-6945be9bf4a0 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:45.924763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be469a4-1d6a-49aa-9823-6945be9bf4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:45.924763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be469a4-1d6a-49aa-9823-6945be9bf4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:45.945449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9be469a4-1d6a-49aa-9823-6945be9bf4a0 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:45.947325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9be469a4-1d6a-49aa-9823-6945be9bf4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:45.958633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1204/2420] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:45.991041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:46.002578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fa565-a30f-4918-b2b6-ae30ce681e7c service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:46.009409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:46.010151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:46.010517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:46.010825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:46.020228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:46.021814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:46.031823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1217/2421] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:53.068094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0726-27d5-4bd1-a1f6-f31754c64a3b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:53.068621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0726-27d5-4bd1-a1f6-f31754c64a3b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:53.068849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0726-27d5-4bd1-a1f6-f31754c64a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:53.090365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b13f0726-27d5-4bd1-a1f6-f31754c64a3b None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:53.091749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b13f0726-27d5-4bd1-a1f6-f31754c64a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:53.103362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1205/2422] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:53.118085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:53.130893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cfd48-be7e-44dd-af03-c71e0f0d111b service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:53.136302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:53.137193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:53.137478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:53.137748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:53.146118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:53.147860 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:53.156074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1218/2423] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:17:54.278826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e672-5f9d-47b5-ba3f-ac7eeca9c2e8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:54.279400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e672-5f9d-47b5-ba3f-ac7eeca9c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:54.279400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e672-5f9d-47b5-ba3f-ac7eeca9c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:54.301293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-a953e672-5f9d-47b5-ba3f-ac7eeca9c2e8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:54.302524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a953e672-5f9d-47b5-ba3f-ac7eeca9c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:54.311850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1206/2424] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:54.337071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:54.353064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d4b9c-7d58-4829-9b42-9f887ce0674c service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:54.359782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:54.360355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:54.360630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:54.360905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:54.370435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:54.372106 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:54.382256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1219/2425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:17:58.542780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:58.543342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:58.543342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:58.567801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:17:58.569602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:17:58.580267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1207/2426] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 13:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:17:58.603433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:17:58.615218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825c2-3217-4d42-8a57-c5daaa4a0bc8 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:17:58.621675 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:17:58.622403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:17:58.622720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:17:58.623058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:17:58.633379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:17:58.635040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:17:58.645855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1220/2427] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:18:08.560018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=15 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:08.641444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=30 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:32.342418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:18:32.343913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:18:32.358007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04708db9-8dfc-4f9f-abd0-64807a9393c3 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:18:32.363035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:18:32.363765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:18:32.364038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:18:32.364303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] PATH_INFO: `/v3/users/88f149665de44da288235cf80f3c58d3` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:18:32.365437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f149665de44da288235cf80f3c58d3)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:18:32.367494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:18:32.416508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f149665de44da288235cf80f3c58d3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.424987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f149665de44da288235cf80f3c58d3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.432128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f149665de44da288235cf80f3c58d3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.432781 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f149665de44da288235cf80f3c58d3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.445084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6a5073f0-c164-4637-9971-1f3e10190b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f149665de44da288235cf80f3c58d3'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.451369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1208/2428] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:18:32 2022] DELETE /identity/v3/users/88f149665de44da288235cf80f3c58d3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:18:32.635364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:18:32.648077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366981c1-7227-4afc-a2d6-98d9ee9aef74 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:18:32.709609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:18:32.710245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:18:32.710527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:18:32.710803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] PATH_INFO: `/v3/projects/41eef7e258ab47c9b6255acc6f9f34fd` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:18:32.711987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] RBAC: Authorizing `identity:delete_project(project_id=41eef7e258ab47c9b6255acc6f9f34fd)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:18:32.713898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:18:32.764093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41eef7e258ab47c9b6255acc6f9f34fd', 'request_id': 'req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.770261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41eef7e258ab47c9b6255acc6f9f34fd', 'request_id': 'req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.779862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41eef7e258ab47c9b6255acc6f9f34fd', 'request_id': 'req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.790822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] The token cache is being invalidate because project 41eef7e258ab47c9b6255acc6f9f34fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:18:32.791110 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.791764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:18:32.793401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1221/2429] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:18:32 2022] DELETE /identity/v3/projects/41eef7e258ab47c9b6255acc6f9f34fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:18:35.501208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:18:35.501782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:18:35.501782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:18:35.522183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] MFA Rules not processed for user `72f072c5cd5d43538aa0106eee042559`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:18:35.523751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:18:35.583932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1209/2430] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:18:42.788295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:18:45.577061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:19:01.863650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:01.866383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:01.946814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7ce8-5ca7-4ffe-9ca0-a93a0ff759da admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:01.952478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:01.953116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:01.953390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:01.953659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:01.955424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:02.014277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:02.015921 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:02.025325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1222/2431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:02.201906 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:02.204054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:02.275014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d12405-be78-44a3-9902-f2b82971d0ab None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:02.279153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:02.279793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:02.280069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:02.280336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:02.282402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:02.296152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:02.297585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68929de-db48-4207-95cc-f1ca9da3fbf2 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:02.308721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1210/2432] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:04.989704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:04.991395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:05.059804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b45fc5-b286-4b62-893e-f7107d8fc69e service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:05.065915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:05.066847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:05.067338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:05.067664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:05.070377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:05.085826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:05.087281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:05.098125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1223/2433] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:10.939657 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:10.940179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:10.940179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:10.960846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] MFA Rules not processed for user `1684906668f04bc985e21078d9057371`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:19:10.962064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:10.970140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1211/2434] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:19:11.292992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:11.294617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:11.306754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa02d4-53fb-4f87-a5b0-c54502476581 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:11.311667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:11.312261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:11.312508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:11.312797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:11.314539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:11.325122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:11.326549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:11.335146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1224/2435] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:11.676684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:11.678246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:11.749546 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685fff-c015-4e47-8323-9d6213a2ddcc None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:11.754422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:11.755031 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:11.755353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:11.755627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:11.757843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:11.781552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:11.783164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:11.793576 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1212/2436] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:13.617801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:13.627112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20278-2415-4686-849d-a1c1083913a4 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:13.630987 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:13.631707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:13.632081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:13.632411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:13.634239 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:13.644707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:13.646166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:13.655745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1225/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:14.315386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:14.317244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:14.333817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18707209-c076-449b-92ac-b4dc3858178c service placement] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:14.339729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:14.340345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:14.340619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:14.340889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:14.342984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:14.355493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:14.357102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d76d6-ca99-4d8a-891b-304e843a45fe service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:14.368271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1213/2438] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:23.511540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:23.518793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:19:23.526215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751c22-81ac-4ca2-938a-b7de9fbd7778 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:23.532486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:23.533097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:23.533370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:23.533621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:23.535459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:23.547966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:23.549562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:23.560644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1226/2439] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:24.364411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=67 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:19:33.556825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:19:44.506168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:44.506678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:44.506782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:44.527166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] MFA Rules not processed for user `4b7f6d085f89478db97ef7da015932ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:19:44.528421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:44.584324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1214/2440] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:19:44.903031 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:44.913305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215861ed-9d2c-4fe3-b72b-2ad6f95dd48c service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:44.917730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:44.918328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:44.918600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:44.918870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:44.920926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:44.930778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:44.932225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:44.940244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1227/2441] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:48.158173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:48.168835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f07f6-7452-42e5-958c-c7c2adb767db None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:48.172716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:48.173325 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:48.173609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:48.173879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:48.175968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:48.188102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:48.189531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:48.199628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1215/2442] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:51.456965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:51.459237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:51.472181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db0757-8e46-4119-9a18-045c942918f5 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:51.476369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:51.476998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:51.477277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:51.477543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:51.479375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:51.545416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:51.546853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcff7d8-4d1f-4719-851b-c75a2f4189cf service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:51.556560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1228/2443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:19:54.455405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:19:54.470374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5efd6b-799c-4fac-981e-cfe53edb3ffb service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:19:54.477047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:19:54.477764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:19:54.478218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:19:54.478488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:19:54.480357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:19:54.494292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:19:54.495941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:19:54.507758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1216/2444] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:01.552083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=34 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:02.641891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:02.642744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:02.642744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:02.662296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] MFA Rules not processed for user `bc188fdd8d7d4697a1203661b7facf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:02.663549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:02.670565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1229/2445] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:04.502375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=37 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:12.656886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:14.073721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:14.083632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3509-dcda-4935-8057-f8bca2bc36e6 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:14.087597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:14.088197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:14.088473 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:14.088742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:14.090511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:14.160005 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:14.162158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:14.174703 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1217/2446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:17.434641 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:17.436553 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:17.460780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3cf81-a826-4f95-b1bd-bdea3443a3bc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:17.468978 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:17.470856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:17.471391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:17.471937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:17.480040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:17.502503 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:17.505244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:17.510795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:17.513171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:17.526256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1230/2447] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:17.527174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f13556-6575-4136-83c8-eff66807b74f service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:17.533903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:17.533903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:17.533903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:17.533903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] PATH_INFO: `/v3/users/72f072c5cd5d43538aa0106eee042559` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:17.534783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f072c5cd5d43538aa0106eee042559)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:17.537018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:17.598385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f072c5cd5d43538aa0106eee042559'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.607277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f072c5cd5d43538aa0106eee042559'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.618190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f072c5cd5d43538aa0106eee042559'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.618891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f072c5cd5d43538aa0106eee042559'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.630548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ba9b5f31-da62-4511-8dcc-5baa5ab3c651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f072c5cd5d43538aa0106eee042559'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.636355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1218/2448] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:20:17 2022] DELETE /identity/v3/users/72f072c5cd5d43538aa0106eee042559 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:17.812790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:17.824017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720561-9f14-4aac-a54d-ef1bcb74cef5 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:17.884058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:17.884615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:17.884886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:17.885165 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] PATH_INFO: `/v3/projects/f63f034745754f019b0d807e663e2774` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:17.886317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63f034745754f019b0d807e663e2774)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:17.888323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:17.936773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63f034745754f019b0d807e663e2774', 'request_id': 'req-07c15a8f-db02-4629-8ddb-3a6cc087474a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.943376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63f034745754f019b0d807e663e2774', 'request_id': 'req-07c15a8f-db02-4629-8ddb-3a6cc087474a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.953774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63f034745754f019b0d807e663e2774', 'request_id': 'req-07c15a8f-db02-4629-8ddb-3a6cc087474a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.964814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] The token cache is being invalidate because project f63f034745754f019b0d807e663e2774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:20:17.965097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.965754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-07c15a8f-db02-4629-8ddb-3a6cc087474a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:17.967321 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1231/2449] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:20:17 2022] DELETE /identity/v3/projects/f63f034745754f019b0d807e663e2774 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:20:17.972350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:17.972638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:17.972912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:17.992859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:17.994078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:18.060041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1219/2450] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:18.067815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.068100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.068383 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.089313 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:18.090529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:18.099923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1232/2451] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:18.104342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.114653 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0c19-fe2c-4ff1-8907-6eddace54e46 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.119695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.120301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.120575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.120841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.121490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:20:18.121774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.123590 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.125236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:18.137578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1220/2452] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:20:18.142353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.155255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52db620-0687-4ca3-9835-1cfc5443c5ac None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.161266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.161868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.162140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.162404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.163022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.165041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.200677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1233/2453] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:18.202053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.212764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313cc0f-e5da-4d43-9066-e3b62e179c99 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.279396 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.280004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.280278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.280545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.281169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.283495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.306312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1221/2454] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:20:18 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:18.310524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.321339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5996-214e-4cdb-8702-ec5f4fc1e801 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.326719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.327356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.327654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.327919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.328558 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.330148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.340127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1234/2455] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:18.344214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.354756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484382-eabe-4a90-8d30-316491e02515 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.360876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.361476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.361751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.362019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.362664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.364291 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a24a-7eff-4866-a25e-01f13f352ac1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.375650 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1222/2456] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:18.379868 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.390735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8245a4-9761-4e05-a17b-07e953f59bbb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.398694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.399705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.400159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.400539 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] PATH_INFO: `/v3/projects/38062b863cbd419e8bdda4293dd6552e/users/e1bb91376ab8438ab447a2f26d46d310/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.423713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38062b863cbd419e8bdda4293dd6552e, user_id=e1bb91376ab8438ab447a2f26d46d310, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.426411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.441168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1235/2457] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:18 2022] PUT /identity/v3/projects/38062b863cbd419e8bdda4293dd6552e/users/e1bb91376ab8438ab447a2f26d46d310/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:18.451783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.452174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.452448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.481258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] MFA Rules not processed for user `e1bb91376ab8438ab447a2f26d46d310`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:18.482592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:18.554363 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1223/2458] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:18.566204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:18.568353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:18.583145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:18.644361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea90c21-27c4-47a6-bce7-2b1dcce73080 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:18.651720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:18.652357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:18.652631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:18.652897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:18.661917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:18.663841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff963db9-1594-4da2-abb3-1f2f91870458 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:18.673609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1236/2459] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:23.933207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:23.997350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362055b5-a0f4-4be2-807b-4cc3ce0a0576 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.002811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:24.003478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.003755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.004025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] PATH_INFO: `/v3/users/e1bb91376ab8438ab447a2f26d46d310` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.005145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bb91376ab8438ab447a2f26d46d310)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:24.007076 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:24.009575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:24.057907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bb91376ab8438ab447a2f26d46d310'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.065946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bb91376ab8438ab447a2f26d46d310'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.073442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bb91376ab8438ab447a2f26d46d310'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.074097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bb91376ab8438ab447a2f26d46d310'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.085849 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bb91376ab8438ab447a2f26d46d310'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.091783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1224/2460] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:20:23 2022] DELETE /identity/v3/users/e1bb91376ab8438ab447a2f26d46d310 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:24.096524 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.096981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.097074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.117441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:24.118959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:24.189461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1237/2461] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:24.199285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:24.200920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:24.266992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b59c-1984-4153-b750-e5ca0779ce61 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.274560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:24.275336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.275647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.276089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.287595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:24.289049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2b1be-416f-4d35-8eb8-13b3a7bce602 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:24.299280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1225/2462] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:24.593112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:24.594657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:24.622804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5734311-d93f-4e31-bae5-344c0519f380 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.628471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:24.629114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.629389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.629657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] PATH_INFO: `/v3/projects/38062b863cbd419e8bdda4293dd6552e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.630869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38062b863cbd419e8bdda4293dd6552e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:24.632951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:24.682530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38062b863cbd419e8bdda4293dd6552e', 'request_id': 'req-bbc000b0-c97c-4f64-94b5-56be18d0515a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.688752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38062b863cbd419e8bdda4293dd6552e', 'request_id': 'req-bbc000b0-c97c-4f64-94b5-56be18d0515a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.697452 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38062b863cbd419e8bdda4293dd6552e', 'request_id': 'req-bbc000b0-c97c-4f64-94b5-56be18d0515a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.708678 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] The token cache is being invalidate because project 38062b863cbd419e8bdda4293dd6552e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:20:24.708918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.709546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bbc000b0-c97c-4f64-94b5-56be18d0515a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:24.711072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1238/2463] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:20:24 2022] DELETE /identity/v3/projects/38062b863cbd419e8bdda4293dd6552e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:20:24.716051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.716331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.716633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.736993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:24.738205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:24.802588 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1226/2464] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:24.813518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.813806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.814081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.834919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:24.836187 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:24.844876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1239/2465] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:24.849244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:24.859346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84318a-6b5e-447b-a29d-01c09044a109 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.864369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:24.864966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.865244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.865516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.866162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:20:24.866464 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:24.868126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:24.879749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1227/2466] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:20:24.883985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:24.893117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467df705-d83a-4316-be3d-0e0d8e092a8e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.898273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:24.898874 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:24.899152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:24.899418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:24.900060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:24.901942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:24.918159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:24.932976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1240/2467] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:24.937243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:24.947677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc08b3-e40e-43a4-a033-3e490439693b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:24.955565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:25.008133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.008742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.009023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.009296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.009910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.011929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.034923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1228/2468] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:20:24 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:25.039487 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.050079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79a352-c382-407c-8f9d-74c957d6ad0a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.055540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.056194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.056475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.056746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.057397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.058994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.069529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1241/2469] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:25.073632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.083943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f6f29-bc22-44ad-9232-f855e780362a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.088731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.089313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.089589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.089852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.090487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.092206 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff67356-3589-4b39-943a-f39390821d83 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.102831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1229/2470] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:25.107152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.117096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27330f-e312-42f4-a919-9126e3abc66f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.121646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.122309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.122620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.122888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] PATH_INFO: `/v3/projects/0644e318ad114b409fe46e4461ff9667/users/679f1ce31c1b46ef88ae03bee85b22f9/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.139995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0644e318ad114b409fe46e4461ff9667, user_id=679f1ce31c1b46ef88ae03bee85b22f9, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.142668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.157544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1242/2471] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:25 2022] PUT /identity/v3/projects/0644e318ad114b409fe46e4461ff9667/users/679f1ce31c1b46ef88ae03bee85b22f9/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:25.167959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.168275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.168535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.199222 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] MFA Rules not processed for user `679f1ce31c1b46ef88ae03bee85b22f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:25.200488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:25.269662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1230/2472] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:25.274903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.341818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e251a-bc66-4b4c-ac12-028bd3dc4584 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.346946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.347591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.347869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.348135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.348753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.350643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.379054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1243/2473] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:20:25 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:25.383278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.394251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2dd8-1495-43ae-8614-85a889572f57 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.450427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.451070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.451382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.451641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.452259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.454174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.476259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1231/2474] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:20:25 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:25.480261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.490900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f76a-2db3-48cb-8211-a2c3fee3b330 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.496001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.496594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.496867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.497134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.497863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.499486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.510525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1244/2475] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:25.516468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.531155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8836-880b-41d5-94c0-8fa2c0136bc2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.536679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.537377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.537647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.537914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] PATH_INFO: `/v3/projects/65ab75ce4336435f9341b9f7b96ebef3/users/d30d202ab97f4b29b4e2f9538e9a1543/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.541344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:25.554984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ab75ce4336435f9341b9f7b96ebef3, user_id=d30d202ab97f4b29b4e2f9538e9a1543, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.557748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.573050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1232/2476] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:25 2022] PUT /identity/v3/projects/65ab75ce4336435f9341b9f7b96ebef3/users/d30d202ab97f4b29b4e2f9538e9a1543/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:25.577372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.587917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9522e2-a6ab-4c68-a305-c77349f6cd8a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.648395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.649000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.649275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.649541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.650164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.651784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada457d-9b64-430a-8d1b-a839f0a5ac5e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.663288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1245/2477] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:25.667633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.678779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1af1aa-2b30-4512-aa53-22662df17af0 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.684132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.684779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.685091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.685358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] PATH_INFO: `/v3/projects/65ab75ce4336435f9341b9f7b96ebef3/users/d30d202ab97f4b29b4e2f9538e9a1543/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.687362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ab75ce4336435f9341b9f7b96ebef3, user_id=d30d202ab97f4b29b4e2f9538e9a1543, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.689991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.700135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1233/2478] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:25 2022] PUT /identity/v3/projects/65ab75ce4336435f9341b9f7b96ebef3/users/d30d202ab97f4b29b4e2f9538e9a1543/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:25.711611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.711937 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.712287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.742098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] MFA Rules not processed for user `d30d202ab97f4b29b4e2f9538e9a1543`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:25.743369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:25.760578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:25.814670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1246/2479] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:25.826016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:25.827938 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:25.885056 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fc1f-f682-4795-bf47-f6e08a57844a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:25.888975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:25.889568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:25.889841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:25.890130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:25.899579 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:25.901017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:25.910197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1234/2480] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:25.991984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:26.002373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683330-fe9e-4275-bfdc-2716887a82ad None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:26.006025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:26.006630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:26.006911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:26.007205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:26.078426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:26.079850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ea14-1000-4575-9bc7-25327f618446 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:26.088770 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1247/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:35.906159 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=37,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:36.084693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=49 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:55.811771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:55.878445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5695-aafe-4ce9-8f4a-45f2ebb567b0 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:55.883116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:55.883786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:55.884186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:55.884459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] PATH_INFO: `/v3/users/679f1ce31c1b46ef88ae03bee85b22f9` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:55.885609 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=679f1ce31c1b46ef88ae03bee85b22f9)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:55.887667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:55.940231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679f1ce31c1b46ef88ae03bee85b22f9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:55.949340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679f1ce31c1b46ef88ae03bee85b22f9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:55.956699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679f1ce31c1b46ef88ae03bee85b22f9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:55.957359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679f1ce31c1b46ef88ae03bee85b22f9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:55.969553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679f1ce31c1b46ef88ae03bee85b22f9'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:55.975676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1235/2482] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:20:55 2022] DELETE /identity/v3/users/679f1ce31c1b46ef88ae03bee85b22f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:55.980236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:55.980738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:55.980832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:56.001116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:56.002324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:56.070259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1248/2483] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:20:56.089607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:56.091135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:56.158455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9083b-d7fd-47aa-8179-d2c2a3a0c3cd admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:56.165530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:56.166456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:56.166814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:56.167247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:56.177862 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:56.179300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:56.188834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1236/2484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:56.478118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:56.479585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:56.491812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbb0b5-70a3-4ec3-bf69-8653e84b85b4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:56.497150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:56.497918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:56.498268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:56.498635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] PATH_INFO: `/v3/projects/0644e318ad114b409fe46e4461ff9667` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:56.500218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0644e318ad114b409fe46e4461ff9667)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:56.502219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:56.552169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0644e318ad114b409fe46e4461ff9667', 'request_id': 'req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.558778 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0644e318ad114b409fe46e4461ff9667', 'request_id': 'req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.569368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0644e318ad114b409fe46e4461ff9667', 'request_id': 'req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.580601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] The token cache is being invalidate because project 0644e318ad114b409fe46e4461ff9667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:20:56.580884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.581562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.583078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1249/2485] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:20:56 2022] DELETE /identity/v3/projects/0644e318ad114b409fe46e4461ff9667 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:56.587530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:56.597960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ef9d-70b5-4953-a4bf-52e1118e1245 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:56.617508 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:56.659520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:56.660169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:56.660438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:56.660714 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] PATH_INFO: `/v3/users/d30d202ab97f4b29b4e2f9538e9a1543` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:56.661861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30d202ab97f4b29b4e2f9538e9a1543)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:56.663886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:56.720744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30d202ab97f4b29b4e2f9538e9a1543'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.733049 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30d202ab97f4b29b4e2f9538e9a1543'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.740882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30d202ab97f4b29b4e2f9538e9a1543'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.741686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30d202ab97f4b29b4e2f9538e9a1543'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.754569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-57712ae6-f700-4d02-9e13-9a04b4116dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30d202ab97f4b29b4e2f9538e9a1543'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:56.761047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1237/2486] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:20:56 2022] DELETE /identity/v3/users/d30d202ab97f4b29b4e2f9538e9a1543 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:57.044986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.046509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:57.060228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d3c0b-8b11-4cdb-b8b4-f8e265a726ce admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.121427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.122609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.122609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.122807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] PATH_INFO: `/v3/projects/65ab75ce4336435f9341b9f7b96ebef3` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.123909 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ab75ce4336435f9341b9f7b96ebef3)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.125869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.161690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:57.180743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ab75ce4336435f9341b9f7b96ebef3', 'request_id': 'req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:57.187592 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ab75ce4336435f9341b9f7b96ebef3', 'request_id': 'req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:57.197796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ab75ce4336435f9341b9f7b96ebef3', 'request_id': 'req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:57.208336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] The token cache is being invalidate because project 65ab75ce4336435f9341b9f7b96ebef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:20:57.208622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:57.209283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c6a774f9-e9cf-422f-b87f-07cbbb8501cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:20:57.210955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1250/2487] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:20:57 2022] DELETE /identity/v3/projects/65ab75ce4336435f9341b9f7b96ebef3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:57.215957 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.216450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.216561 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.236432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:57.237728 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:57.300555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1238/2488] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:57.311473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.311759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.312032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.333299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:57.334540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:57.344387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1251/2489] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:57.349512 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.361995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdd2b-8430-4aa9-bbe6-096e8146181f None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.368029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.368685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.368973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.369239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.369883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:20:57.370184 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.371990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.384379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1239/2490] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:20:57.389587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.408300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570274d-913d-463a-8fe6-fb70780b8007 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.417880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.418567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.418840 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.419100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.419777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.421655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.452126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1252/2491] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:57.456413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.466926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85b29-0dfa-4a68-af34-4fdf5b943d03 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.495045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:57.526392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.526996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.527452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.527715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.528337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.530279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.552916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1240/2492] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:57.557057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.567703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9a2ec-e242-439f-85f4-6115fbe4305b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.573344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.573939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.574245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.574514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.575290 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.576832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.589682 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1253/2493] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:20:57.593976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.605832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c837d-118f-4247-8bfe-c64861ac7407 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.611608 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.612336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.612719 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.613107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.613844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.615500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba90701-3041-4776-b2b9-c24a1d2a3f0a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.627282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1241/2494] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:57.631755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.642080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721f0e3-647b-40fa-8679-a1ffb48db791 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.647829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.648501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.648785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.649057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] PATH_INFO: `/v3/projects/01a6ce3ddb524befba64cbaf820325ff/users/558f71e268cd45c8a27fc4504be6ef22/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.663783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a6ce3ddb524befba64cbaf820325ff, user_id=558f71e268cd45c8a27fc4504be6ef22, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.666438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.681586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1254/2495] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:57 2022] PUT /identity/v3/projects/01a6ce3ddb524befba64cbaf820325ff/users/558f71e268cd45c8a27fc4504be6ef22/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:57.693330 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.693616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.693888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.724685 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] MFA Rules not processed for user `558f71e268cd45c8a27fc4504be6ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:57.725915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:57.793670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1242/2496] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:57.798408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.863276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b349-d93d-45a5-a63d-db76a61d19cb admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.869056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.869817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.870173 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.870556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.871575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.873917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:57.905519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1255/2497] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:20:57.909643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:57.920769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ed3a-2229-452c-af18-774fa87da702 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:57.979562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:57.980171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:57.980448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:57.980724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:57.981357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:57.983322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.007831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1243/2498] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:20:57 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:20:58.012113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.023241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589871-53ad-4cef-a325-0090bcc1de03 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.028629 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.029204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.029485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.029748 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.030413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.032050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.043046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1256/2499] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:20:58.047462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.058048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ceb96-a377-4942-96f5-a762d8b8db77 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.063470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.064171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.064452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.064721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] PATH_INFO: `/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f/users/88173f9caa9148c1827862ba08d2ce41/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.080370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954a8384f7174b73b0356ac7b1e3cb1f, user_id=88173f9caa9148c1827862ba08d2ce41, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.083047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.098451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1244/2500] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:58 2022] PUT /identity/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f/users/88173f9caa9148c1827862ba08d2ce41/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:20:58.102728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.113464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f2e7-209a-4a77-bb84-3e47d56e81de admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.135220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:58.179261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.179875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.180151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.180417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.181058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.182659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d578fde-a7a8-4d1f-88df-49be2d9be37a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.193318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1257/2501] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:20:58.197901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.203863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:20:58.210092 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0610fa8-35d2-40c9-b5c8-62e0c66824a5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.216116 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.216903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.217186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.217453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] PATH_INFO: `/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f/users/88173f9caa9148c1827862ba08d2ce41/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.219632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954a8384f7174b73b0356ac7b1e3cb1f, user_id=88173f9caa9148c1827862ba08d2ce41, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.222303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.234193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1245/2502] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:20:58 2022] PUT /identity/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f/users/88173f9caa9148c1827862ba08d2ce41/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:20:58.244491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.244775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.245048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.274053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] MFA Rules not processed for user `88173f9caa9148c1827862ba08d2ce41`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:20:58.275324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:58.345817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1258/2503] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:20:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:20:58.357713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.359602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:20:58.417988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa37d9-aeea-4de6-9b47-e42ab5f75fe3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.421982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.422582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.422858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.423125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.432869 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.434334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503a6d-333a-4836-a108-21841d7a8076 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.443931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1246/2504] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:20:58.527407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:20:58.537453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588625f-e0ee-4996-a1a1-25c00bcd5f8c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:20:58.541225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:20:58.541824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:20:58.542099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:20:58.542364 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:20:58.599810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:20:58.601323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:20:58.611029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1259/2505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:20:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:04.149101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1097-33b6-468f-9297-7956bee56240 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:04.149573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1097-33b6-468f-9297-7956bee56240 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:04.149666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1097-33b6-468f-9297-7956bee56240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:04.169791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-122e1097-33b6-468f-9297-7956bee56240 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:04.171214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-122e1097-33b6-468f-9297-7956bee56240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:04.234014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1247/2506] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:04.286928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:04.288701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:04.352801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:04.380991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea0e27-b5c3-4fcd-abef-d6b74a97778d service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:04.386979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:04.387646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:04.387924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:04.388196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:04.397642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:04.399483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5a67d-e4ce-46a8-9bad-cb0a7202e560 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:04.408867 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1260/2507] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:21:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:21:06.659226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e1097-33b6-468f-9297-7956bee56240 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:06.727753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e1097-33b6-468f-9297-7956bee56240 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:06.732738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:06.734214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:06.734970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:06.735759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] PATH_INFO: `/v3/users/558f71e268cd45c8a27fc4504be6ef22` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:06.737642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558f71e268cd45c8a27fc4504be6ef22)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:06.739596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:06.812717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:06.824345 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558f71e268cd45c8a27fc4504be6ef22'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:06.836453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558f71e268cd45c8a27fc4504be6ef22'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:06.849091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558f71e268cd45c8a27fc4504be6ef22'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:06.849987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558f71e268cd45c8a27fc4504be6ef22'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:06.874596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558f71e268cd45c8a27fc4504be6ef22'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:06.882365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1248/2508] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:21:06 2022] DELETE /identity/v3/users/558f71e268cd45c8a27fc4504be6ef22 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:06.887508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:06.888884 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:06.889509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:06.922089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:06.923362 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:07.015902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1261/2509] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:07.026706 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:07.028166 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:07.091710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fddd4-3560-4e4a-aeb3-1d6108c25b49 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:07.095315 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:07.095956 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:07.096233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:07.096497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:07.106143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:07.108109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:07.120858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1249/2510] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:07.495920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:07.498122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:07.527357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951821c-f21f-4550-97b9-548dec4b7814 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:07.533325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:07.533972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:07.534254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:07.534520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] PATH_INFO: `/v3/projects/01a6ce3ddb524befba64cbaf820325ff` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:07.535691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a6ce3ddb524befba64cbaf820325ff)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:07.538140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:07.595090 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a6ce3ddb524befba64cbaf820325ff', 'request_id': 'req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.601672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a6ce3ddb524befba64cbaf820325ff', 'request_id': 'req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.616242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a6ce3ddb524befba64cbaf820325ff', 'request_id': 'req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.630195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] The token cache is being invalidate because project 01a6ce3ddb524befba64cbaf820325ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:21:07.630634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.631326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.633922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1262/2511] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:21:07 2022] DELETE /identity/v3/projects/01a6ce3ddb524befba64cbaf820325ff => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:07.637428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:07.649593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9903a-b8ee-4c66-ac32-7dc881291e65 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:07.714417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:07.715145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:07.715529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:07.715800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] PATH_INFO: `/v3/users/88173f9caa9148c1827862ba08d2ce41` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:07.717094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=88173f9caa9148c1827862ba08d2ce41)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:07.719259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:07.775306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88173f9caa9148c1827862ba08d2ce41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.786665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88173f9caa9148c1827862ba08d2ce41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.795600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:07.798686 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88173f9caa9148c1827862ba08d2ce41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.800003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88173f9caa9148c1827862ba08d2ce41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.820205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-aceead10-37c2-4ec3-a90c-6fa78972d9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88173f9caa9148c1827862ba08d2ce41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:07.827750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1250/2512] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:21:07 2022] DELETE /identity/v3/users/88173f9caa9148c1827862ba08d2ce41 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:08.171274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.173355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:08.206029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0330-ed47-4788-8aef-a5bfdf6f9a65 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.267395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:08.275948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.277218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.277845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.278340 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] PATH_INFO: `/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.280057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] RBAC: Authorizing `identity:delete_project(project_id=954a8384f7174b73b0356ac7b1e3cb1f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.282020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.336124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954a8384f7174b73b0356ac7b1e3cb1f', 'request_id': 'req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:08.343876 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954a8384f7174b73b0356ac7b1e3cb1f', 'request_id': 'req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:08.356428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954a8384f7174b73b0356ac7b1e3cb1f', 'request_id': 'req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:08.369189 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] The token cache is being invalidate because project 954a8384f7174b73b0356ac7b1e3cb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:21:08.369672 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:08.370341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0f40bcfd-4fe4-4edc-a2a8-fbd6caea721f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:08.371969 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1263/2513] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:21:08 2022] DELETE /identity/v3/projects/954a8384f7174b73b0356ac7b1e3cb1f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:08.378416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39846f57-5796-4845-937b-1301dd891391 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.378877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39846f57-5796-4845-937b-1301dd891391 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.379014 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39846f57-5796-4845-937b-1301dd891391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.401007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-39846f57-5796-4845-937b-1301dd891391 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:08.402381 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-39846f57-5796-4845-937b-1301dd891391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:08.467832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1251/2514] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:08.477211 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.477735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.478094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.499616 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:08.500992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:08.511230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1264/2515] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:21:08.515300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39846f57-5796-4845-937b-1301dd891391 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.526961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39846f57-5796-4845-937b-1301dd891391 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.532292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.533133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.533830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.534004 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.534763 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:21:08.535129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.537006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.549935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1252/2516] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:21:08.554433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.564318 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba5157-9a20-4735-b57a-951aa1892142 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.569212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.569829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.570122 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.570483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.571009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.572960 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.603146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1265/2517] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:21:08 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:21:08.607359 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.619336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bf518-481b-48ac-8dca-a31033d05bdd admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.683281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.683803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.684081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.684346 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.684980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.686997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.713623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1253/2518] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:21:08 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:21:08.715214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.727526 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f54f6-aedb-454f-b35a-75ad7e58bc57 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.734784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.735541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.735883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.736237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.737087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.738774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.755737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.756950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1266/2519] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:21:08.768281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536fdd-6177-4d83-9813-ed20ec16cac8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.773458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.774074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.774353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.774622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.775411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.777852 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260d99-259c-4496-9036-27d0bfaf1659 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.794197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1254/2520] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:21:08.795628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.806331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c963-9e93-4744-b32e-b0348de33e81 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:08.811631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:08.812297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.812580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.812853 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] PATH_INFO: `/v3/projects/ce1cb62ba6a64a2ba0d85af3a1732c66/users/92331edbc2804afb853ce71dc5822558/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.830260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1cb62ba6a64a2ba0d85af3a1732c66, user_id=92331edbc2804afb853ce71dc5822558, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:08.833228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:08.850076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1267/2521] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:21:08 2022] PUT /identity/v3/projects/ce1cb62ba6a64a2ba0d85af3a1732c66/users/92331edbc2804afb853ce71dc5822558/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:08.861154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:08.861681 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:08.862081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:08.895247 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] MFA Rules not processed for user `92331edbc2804afb853ce71dc5822558`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:08.897236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:08.933805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:08.976082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1255/2522] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:21:08.987991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:08.989911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:09.066275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a544-832c-4ded-bfda-142249abcb05 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:09.070698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:09.071355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:09.071636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:09.071906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:09.085551 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:09.087036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9f358-f4ac-47b1-80e7-a8f171299cd3 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:09.098877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1268/2523] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:09.120883 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:09.201011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a18b-21e9-4df1-857a-e165a8bea150 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:09.206442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:09.207167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:09.208240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:09.208611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] PATH_INFO: `/v3/users/92331edbc2804afb853ce71dc5822558` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:09.210600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92331edbc2804afb853ce71dc5822558)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:09.214395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:09.287553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92331edbc2804afb853ce71dc5822558'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.298442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92331edbc2804afb853ce71dc5822558'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.312020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92331edbc2804afb853ce71dc5822558'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.312754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92331edbc2804afb853ce71dc5822558'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.328100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92331edbc2804afb853ce71dc5822558'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.335850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1256/2524] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:21:09 2022] DELETE /identity/v3/users/92331edbc2804afb853ce71dc5822558 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:09.341519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:09.342101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:09.342622 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:09.366878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:09.368698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:09.395161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:09.445793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1269/2525] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:09.461113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:09.462528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:09.532385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167066-b974-47cd-b248-58d7d43d7927 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:09.536919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:09.537542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:09.538240 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:09.538380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:09.548157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:09.554918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:09.556538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2671f-019c-4401-91f0-1e8abde181f9 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:09.575518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1257/2526] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:09.882391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:09.883848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:09.898317 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77c64-ab1e-4af3-afc6-531236cb65c8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:09.916562 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:09.917380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:09.917870 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:09.918898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] PATH_INFO: `/v3/projects/ce1cb62ba6a64a2ba0d85af3a1732c66` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:09.920901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1cb62ba6a64a2ba0d85af3a1732c66)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:09.923632 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:09.980385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1cb62ba6a64a2ba0d85af3a1732c66', 'request_id': 'req-0b8deb0c-8649-4834-a011-8086e29bb867'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.988398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1cb62ba6a64a2ba0d85af3a1732c66', 'request_id': 'req-0b8deb0c-8649-4834-a011-8086e29bb867'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:09.998450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1cb62ba6a64a2ba0d85af3a1732c66', 'request_id': 'req-0b8deb0c-8649-4834-a011-8086e29bb867'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:10.019284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] The token cache is being invalidate because project ce1cb62ba6a64a2ba0d85af3a1732c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:21:10.019615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:10.020254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-0b8deb0c-8649-4834-a011-8086e29bb867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:10.025398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1270/2527] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:21:09 2022] DELETE /identity/v3/projects/ce1cb62ba6a64a2ba0d85af3a1732c66 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:10.027443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.027992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.027992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.049033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:10.050712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:10.120385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1258/2528] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:10.128097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468315-53b0-4281-8666-5564820a617f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.128426 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468315-53b0-4281-8666-5564820a617f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.128744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468315-53b0-4281-8666-5564820a617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.153991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-7f468315-53b0-4281-8666-5564820a617f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:10.155336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7f468315-53b0-4281-8666-5564820a617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:10.164418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1271/2529] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:10.168659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.179766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0b60-15e3-4d7c-846e-bae2ce6c12e1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.184496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.185113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.185388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.186172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.186857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:21:10.187163 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.188827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.204584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1259/2530] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:21:10.208935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468315-53b0-4281-8666-5564820a617f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.218983 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468315-53b0-4281-8666-5564820a617f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.224057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.224784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.225137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.225485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.226141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.228194 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.261877 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1272/2531] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:21:10 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:21:10.266401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.278072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289af09-b8f2-4521-9229-8ffbbcda1d47 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.359117 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.360641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.360984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.361332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.362082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.364305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.395429 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1260/2532] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:21:10 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:21:10.400138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.415529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee031-2184-4a66-ab61-be5aa41afe40 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.421423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.422401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.423116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.423582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.424319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.426284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.440910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1273/2533] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:21:10.445405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.457261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024667-2752-4762-8b5a-3b5ea6d0cfbf admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.462336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.462972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.465594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.465594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.465594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.466101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bc410-f4d2-4554-91e1-fde8a50f77f3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.481265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1261/2534] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:21:10.485442 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.500989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a24833-5fd3-48cf-9bc0-6b43c0c9eaf2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.512883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.513810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.514196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.515243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] PATH_INFO: `/v3/projects/d1d7c00378f54757af9ab6846badb16a/users/ae907f378cdf4e12a72e0e182c822498/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.536262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d7c00378f54757af9ab6846badb16a, user_id=ae907f378cdf4e12a72e0e182c822498, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.539092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.561470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1274/2535] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:21:10 2022] PUT /identity/v3/projects/d1d7c00378f54757af9ab6846badb16a/users/ae907f378cdf4e12a72e0e182c822498/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:21:10.572949 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511bf4-a03c-4b99-8328-897066f20d12 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.573233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511bf4-a03c-4b99-8328-897066f20d12 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.573656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511bf4-a03c-4b99-8328-897066f20d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.610242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-32511bf4-a03c-4b99-8328-897066f20d12 None None] MFA Rules not processed for user `ae907f378cdf4e12a72e0e182c822498`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:10.611968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-32511bf4-a03c-4b99-8328-897066f20d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:10.698684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:10.721471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1262/2536] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:21:10.739963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:10.741896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:10.817970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:10.825961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327757-9925-47e2-868e-80acdfaf80e1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:10.831903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:10.833365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:10.834093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:10.834374 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:10.846895 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:10.848809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aadeb3-c478-4e5b-a653-b7fff616dc67 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:10.861365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1275/2537] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:18.832826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:18.833402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:18.833600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:18.835225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1263/2538] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:21:18.841594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c375-a7db-4f00-a9e5-b669196ed654 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:18.842053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c375-a7db-4f00-a9e5-b669196ed654 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:18.842227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307c375-a7db-4f00-a9e5-b669196ed654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:18.864653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d307c375-a7db-4f00-a9e5-b669196ed654 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:18.865878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d307c375-a7db-4f00-a9e5-b669196ed654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:18.938368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1276/2539] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:21:18.952481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:18.954165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:19.012249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79674f77-f94f-49c8-971a-3743c6360c28 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:19.020203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:19.020845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.021445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.021713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.037376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:19.038899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4867a-83cb-4d4e-a22e-7cc69e3e53e2 service glance] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:19.050269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1264/2540] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:19.132864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.133072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.133351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] PATH_INFO: `/` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.134738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1277/2541] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:21:19.139780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309d-5adf-4f5c-8a24-82d818e6f950 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.140066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309d-5adf-4f5c-8a24-82d818e6f950 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.140337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d309d-5adf-4f5c-8a24-82d818e6f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.161709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-820d309d-5adf-4f5c-8a24-82d818e6f950 None None] MFA Rules not processed for user `3509a6c850854eb7904672398e2d6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:19.162925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-820d309d-5adf-4f5c-8a24-82d818e6f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:19.219277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1265/2542] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:21:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:19.233390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:19.235138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:19.248660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f078-c159-46a4-ba16-9cc322119b4f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:19.253223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:19.253576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.253855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.254121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.262168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:19.263680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbff34-0c16-46a9-aa0c-704e4934ad0e service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:19.272075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1278/2543] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:19.360718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef5fc-143b-42a9-82d1-0ee0c84a0690 None None] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.361006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef5fc-143b-42a9-82d1-0ee0c84a0690 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.361278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef5fc-143b-42a9-82d1-0ee0c84a0690 None None] PATH_INFO: `/` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.362673 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1266/2544] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 13:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 13:21:19.368169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd663-299e-4eba-a699-f04ba2927b07 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.368477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd663-299e-4eba-a699-f04ba2927b07 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.368749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd663-299e-4eba-a699-f04ba2927b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.390574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dc5bd663-299e-4eba-a699-f04ba2927b07 None None] MFA Rules not processed for user `acc4c0a07dfa4d738ce279cafb5fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:19.391714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dc5bd663-299e-4eba-a699-f04ba2927b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:19.402138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1279/2545] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 13:21:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:19.412967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ef5fc-143b-42a9-82d1-0ee0c84a0690 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:19.425730 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ef5fc-143b-42a9-82d1-0ee0c84a0690 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:19.432942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:19.433794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:19.434171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:19.434557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:19.452660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:19.454846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:19.466284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1267/2546] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:21.295400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:21.295889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:21.296079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:21.315307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:21.316509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:21.369861 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1280/2547] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:21:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:21.382282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:21.383841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:21.455577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604104b9-2430-4b01-9654-ced62b0325b2 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:21.462097 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:21.462698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:21.462999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:21.463326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:21.472328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:21.473921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1fe23-aa99-4c6e-8ec5-c69d272d888b service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:21.482115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1268/2548] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:21:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:21:21.509882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:21.586753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed0126-5819-4159-9393-08db3691fd0d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:21.592790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:21.593560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:21.593928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:21.594358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] PATH_INFO: `/v3/users/ae907f378cdf4e12a72e0e182c822498` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:21.595871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae907f378cdf4e12a72e0e182c822498)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:21.598111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:21.619560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:21.705019 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae907f378cdf4e12a72e0e182c822498'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:21.706141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae907f378cdf4e12a72e0e182c822498'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:21.706998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae907f378cdf4e12a72e0e182c822498'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:21.722095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae907f378cdf4e12a72e0e182c822498'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:21.733248 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae907f378cdf4e12a72e0e182c822498'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:21.754955 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1281/2549] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:21:21 2022] DELETE /identity/v3/users/ae907f378cdf4e12a72e0e182c822498 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:21.760054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:21.763890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:21.764367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:21.800791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:21.802214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:21.818120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:21.907841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1269/2550] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:21.913588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:21.915372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:21.981634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24742c-dabc-44e8-a889-9ed7a728b911 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:21.986573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:21.987600 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:21.988353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:21.988821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.000034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.001733 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc513f-be04-4afd-8052-4534048ff869 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.012964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1282/2551] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:21:22.308263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.309886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:22.326958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc00fb-157a-4d62-b1d6-84e6e6baf440 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.331756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.332402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.332683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.332951 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] PATH_INFO: `/v3/projects/d1d7c00378f54757af9ab6846badb16a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.334070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d7c00378f54757af9ab6846badb16a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.336074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.390140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d7c00378f54757af9ab6846badb16a', 'request_id': 'req-1b962898-d5e4-4e24-b02d-177e9929ef1a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:22.400435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d7c00378f54757af9ab6846badb16a', 'request_id': 'req-1b962898-d5e4-4e24-b02d-177e9929ef1a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:22.417926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d7c00378f54757af9ab6846badb16a', 'request_id': 'req-1b962898-d5e4-4e24-b02d-177e9929ef1a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:22.443654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] The token cache is being invalidate because project d1d7c00378f54757af9ab6846badb16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:21:22.444109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:22.445962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1b962898-d5e4-4e24-b02d-177e9929ef1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:22.448366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1270/2552] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:21:22 2022] DELETE /identity/v3/projects/d1d7c00378f54757af9ab6846badb16a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:22.453047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.453570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.453570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.498443 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:22.499728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:22.563619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1283/2553] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:22.571838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.572126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.572404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.599775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:22.601769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:22.614876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1271/2554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:22.619251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.629669 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb651acb-63b1-40e1-8bf0-41c451b12195 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.634654 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.635287 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.635692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.635963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.636715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:21:22.637038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.638637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.653591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1284/2555] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:21:22.656003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.666080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f09f41-668f-4b6c-a2cd-6921492d1ea6 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.671170 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.671801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.672080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.672354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.673118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.675220 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.704327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1272/2556] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:21:22 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:21:22.708731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.719549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316673d-ca07-48f3-ab79-638f149b199c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.732004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:22.779711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.780235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.780509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.780776 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.781391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.783408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.804365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1285/2557] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:21:22 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:21:22.808687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.819764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7162cc-687c-481c-ba8f-7f9386a2ab1f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.824726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.825387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.825660 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.825928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.826575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.828926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.845569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1273/2558] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:21:22.850492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.873563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92cf7-3be6-4388-8dfe-554fcb17901b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.880670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.881298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.881581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.881854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.882567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.884236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d70f03-6d2a-4bb7-ab38-a58c21e5ceff admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.897511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1286/2559] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:21:22.902221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:22.913287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612dc52-1711-4e1c-ae4c-fdf40bf0c13f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:22.918015 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:22.918718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.919010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.919307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] PATH_INFO: `/v3/projects/bc268b6fcb444596be4292c2c722749d/users/79babaacb8dc43948d2f1e578ab238e7/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:22.943695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc268b6fcb444596be4292c2c722749d, user_id=79babaacb8dc43948d2f1e578ab238e7, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:22.947073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:22.962462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1274/2560] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:21:22 2022] PUT /identity/v3/projects/bc268b6fcb444596be4292c2c722749d/users/79babaacb8dc43948d2f1e578ab238e7/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:22.972764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:22.973044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:22.973311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:23.000329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] MFA Rules not processed for user `79babaacb8dc43948d2f1e578ab238e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:23.001565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:23.088184 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1287/2561] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:23.102371 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:23.104528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:23.174896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:23.191465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a104-93af-4a35-814c-a8e7ebbd9e85 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:23.195635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:23.196446 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:23.196786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:23.197401 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:23.206817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:23.208472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:23.217595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1275/2562] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:27.912094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:27.914326 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:27.994707 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511e43a-69b6-4482-878e-2abedf9c9fcc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:28.000831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:28.001473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:28.001750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:28.002032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:28.003908 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:28.025271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:28.088510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:28.090454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb5604-4db7-45c8-9f73-8e1a6eb5cc2c service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:28.100500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1288/2563] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:28.431243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:28.505235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950e7b-f46f-4ea8-9ea1-bf5139e76b87 service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:28.510385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:28.511133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:28.511532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:28.511909 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] PATH_INFO: `/v3/users/79babaacb8dc43948d2f1e578ab238e7` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:28.513311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79babaacb8dc43948d2f1e578ab238e7)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:28.515460 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:28.565130 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79babaacb8dc43948d2f1e578ab238e7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:28.573788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79babaacb8dc43948d2f1e578ab238e7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:28.581144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79babaacb8dc43948d2f1e578ab238e7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:28.581836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79babaacb8dc43948d2f1e578ab238e7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:28.593840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79babaacb8dc43948d2f1e578ab238e7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:28.600045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1276/2564] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:21:28 2022] DELETE /identity/v3/users/79babaacb8dc43948d2f1e578ab238e7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:28.604522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:28.604809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:28.605087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:28.625094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:28.626330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:28.682745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1289/2565] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:28.694349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:28.696658 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:28.762306 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a5dcf-40b5-48d2-a850-12be7f27f24a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:28.766679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:28.767428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:28.767793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:28.768120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:28.779511 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:28.781021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc14b2d-8994-40eb-ba94-724716f45cd5 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:28.792893 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1277/2566] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:21:29.081138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:29.082638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:29.107907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312ffc-42bf-4547-8dd4-b16823259a64 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:29.113933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:29.114719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:29.114971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:29.115296 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] PATH_INFO: `/v3/projects/bc268b6fcb444596be4292c2c722749d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:29.116508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc268b6fcb444596be4292c2c722749d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:29.118515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:29.183320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc268b6fcb444596be4292c2c722749d', 'request_id': 'req-f1486b89-95eb-4ccc-8d40-0f706c6e5093'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:29.189577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc268b6fcb444596be4292c2c722749d', 'request_id': 'req-f1486b89-95eb-4ccc-8d40-0f706c6e5093'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:29.199660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc268b6fcb444596be4292c2c722749d', 'request_id': 'req-f1486b89-95eb-4ccc-8d40-0f706c6e5093'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:29.210594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] The token cache is being invalidate because project bc268b6fcb444596be4292c2c722749d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:21:29.210903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:29.211588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:21:29.213207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1290/2567] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:21:29 2022] DELETE /identity/v3/projects/bc268b6fcb444596be4292c2c722749d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:21:38.788128 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:39.207598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:43.814845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86059c-25ad-4b57-8f02-05f328463859 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:43.815386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86059c-25ad-4b57-8f02-05f328463859 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:43.815493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86059c-25ad-4b57-8f02-05f328463859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:43.854649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3a86059c-25ad-4b57-8f02-05f328463859 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:43.855815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3a86059c-25ad-4b57-8f02-05f328463859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:43.938928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1278/2568] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:21:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:43.952134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:21:43.953706 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:44.055169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1486b89-95eb-4ccc-8d40-0f706c6e5093 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:21:44.061068 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:21:44.061680 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:44.061953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:44.062218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:44.070838 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:21:44.072478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:21:44.080935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1291/2569] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:21:49.397640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:21:49.398217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:21:49.398217 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:21:49.420484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] MFA Rules not processed for user `4b7f6d085f89478db97ef7da015932ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:21:49.421701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:21:49.478060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1279/2570] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:21:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:21:54.077593 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=43 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:21:59.470679 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=70 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:05.387847 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:05.389504 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:05.487061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4f92-518a-4793-8c74-18c6b9628fcc service swift] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:05.492216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:05.492824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:05.493098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:05.493370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:05.495147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:05.506768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:05.508368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:05.518269 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1292/2571] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:10.434903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:10.436433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:10.516978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94958d4a-9485-4ce3-a98a-b7dc2a9def24 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:10.521377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:10.521974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:10.522251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:10.522541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:10.524601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:10.619931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:10.621428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:10.641471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1280/2572] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:22:13.785001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:13.786492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:13.799559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491d582-97f7-4e50-996f-203f5ec521f5 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:13.804886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:13.805688 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:13.805971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:13.806246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:13.808079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:13.820337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:13.821869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:13.842886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1293/2573] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:13.847035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:13.848612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:13.861019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf8f5-3245-4b3a-8626-07b2e1bc78f7 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:13.867924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:13.868568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:13.868843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:13.869111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] PATH_INFO: `/v3/users/bc188fdd8d7d4697a1203661b7facf1d` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:13.870226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc188fdd8d7d4697a1203661b7facf1d)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:13.872196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:13.921272 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc188fdd8d7d4697a1203661b7facf1d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:13.930131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc188fdd8d7d4697a1203661b7facf1d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:13.932469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:13.938611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc188fdd8d7d4697a1203661b7facf1d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:13.939959 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc188fdd8d7d4697a1203661b7facf1d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:13.952580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c90b2a6f-959c-48ba-ba9d-9f7fc7c97740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc188fdd8d7d4697a1203661b7facf1d'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:13.958682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1281/2574] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:13 2022] DELETE /identity/v3/users/bc188fdd8d7d4697a1203661b7facf1d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:14.146376 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.157905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbfaa-51d6-4f12-9fcf-a7c3360d5cf9 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.217549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.218174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.218450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.218720 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] PATH_INFO: `/v3/projects/2c5f4473449f40b98d1c0e0c13ca0d1f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.219888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5f4473449f40b98d1c0e0c13ca0d1f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.221782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.274378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5f4473449f40b98d1c0e0c13ca0d1f', 'request_id': 'req-c312d04e-e5ed-45e7-b798-40f17acff8f2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:14.280550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5f4473449f40b98d1c0e0c13ca0d1f', 'request_id': 'req-c312d04e-e5ed-45e7-b798-40f17acff8f2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:14.284193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:14.289423 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5f4473449f40b98d1c0e0c13ca0d1f', 'request_id': 'req-c312d04e-e5ed-45e7-b798-40f17acff8f2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:14.301210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] The token cache is being invalidate because project 2c5f4473449f40b98d1c0e0c13ca0d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:14.301494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:14.302123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c312d04e-e5ed-45e7-b798-40f17acff8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:14.303653 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1294/2575] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:14 2022] DELETE /identity/v3/projects/2c5f4473449f40b98d1c0e0c13ca0d1f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:14.308866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.309152 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.309424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.368731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:14.369903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:14.431304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1282/2576] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:14.440403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.440810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.441105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.468220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:14.470046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:14.483358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1295/2577] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:14.488386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.498631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9146-536a-49da-9e73-704dc92710eb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.504622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.505218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.505495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.505756 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.506389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:14.506684 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.508433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.520751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1283/2578] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:14.525097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.535581 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216ba9-7ca3-45cb-a0d9-ed5dc611e3bf None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.541418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.542021 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.542299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.542569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.543225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.545139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.579834 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1296/2579] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:14.585678 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.598850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078ea40-c27b-4ddb-9eb1-0ae0ff4c963c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.658030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.658637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.658914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.659200 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.659842 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.661767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.684892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1284/2580] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:14.689151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.699759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474532c6-35db-4f44-b84d-868609f62945 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.705797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.706400 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.706673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.711854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.712633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.714256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.725379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1297/2581] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:14.731300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.742348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d5bbd-6d6b-4bd6-9093-f471be5c27c2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.748293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.748891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.749167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.749448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.750081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.751801 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee08ae-219a-450d-ae6a-90a106b82437 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.763172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1285/2582] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:14.767509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:14.778575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fbbbf-7be2-4d79-8185-9102f750b4d6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:14.783750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:14.784408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.784667 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.784949 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] PATH_INFO: `/v3/projects/52f044956b2a49e69a089c4d3eb3e930/users/4365daa0034444e2aa8e489c20b0e362/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.800731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f044956b2a49e69a089c4d3eb3e930, user_id=4365daa0034444e2aa8e489c20b0e362, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:14.803413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:14.820205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1298/2583] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:14 2022] PUT /identity/v3/projects/52f044956b2a49e69a089c4d3eb3e930/users/4365daa0034444e2aa8e489c20b0e362/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:22:14.832336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044210-8199-4859-b401-4101a71a3838 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:14.832615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044210-8199-4859-b401-4101a71a3838 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:14.832887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044210-8199-4859-b401-4101a71a3838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:14.853271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:14.862835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ce044210-8199-4859-b401-4101a71a3838 None None] MFA Rules not processed for user `4365daa0034444e2aa8e489c20b0e362`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:14.865119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ce044210-8199-4859-b401-4101a71a3838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:14.932770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1286/2584] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:14.937387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.009067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc6b9a-d6e9-476b-91d4-5c2d0f94a9ba admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.014555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.015160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.015469 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.015736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.016464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.018367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.051756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1299/2585] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:14 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:15.056194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044210-8199-4859-b401-4101a71a3838 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.067285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044210-8199-4859-b401-4101a71a3838 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.133342 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.133943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.134219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.134485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.135120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.137102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.160713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1287/2586] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:15 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:15.165007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.175659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1993d9-24aa-4152-bf7e-587e8fd049de admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.180758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.181345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.181621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.181893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.182536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.184176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.195288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1300/2587] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:15.199541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.209794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe576f-01ff-4970-a787-56d977158e20 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.214824 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.215501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.215779 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.216020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] PATH_INFO: `/v3/projects/d61ca4afcea54c6da7659d343d4a539f/users/24845e8d1e58448d9ee1df86a52bcca8/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.231580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61ca4afcea54c6da7659d343d4a539f, user_id=24845e8d1e58448d9ee1df86a52bcca8, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.234294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.253305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1288/2588] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:15 2022] PUT /identity/v3/projects/d61ca4afcea54c6da7659d343d4a539f/users/24845e8d1e58448d9ee1df86a52bcca8/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:15.258100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.272887 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca04fc-64c3-4532-b1b9-eb32e4da04c8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.327077 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:15.335571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.336506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.337069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.337396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.338224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.339858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac4eb5-b657-411e-8325-01cbec0c0c6b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.349728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1301/2589] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:15.354199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.365051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e741-0f1d-4f62-9a58-dc5004e9074b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.369991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.370634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.370904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.371173 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] PATH_INFO: `/v3/projects/d61ca4afcea54c6da7659d343d4a539f/users/24845e8d1e58448d9ee1df86a52bcca8/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.373495 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61ca4afcea54c6da7659d343d4a539f, user_id=24845e8d1e58448d9ee1df86a52bcca8, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.376320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.386734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1289/2590] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:15 2022] PUT /identity/v3/projects/d61ca4afcea54c6da7659d343d4a539f/users/24845e8d1e58448d9ee1df86a52bcca8/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:15.397347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.397636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.397915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.426154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] MFA Rules not processed for user `24845e8d1e58448d9ee1df86a52bcca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:15.427312 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:15.495563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1302/2591] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:15.507410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.509286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:15.565771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:15.591581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cde00c-94d2-4b90-a98e-8088ac8a8f3c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.595635 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.596229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.596501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.596765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.605836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.607614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.617662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1290/2592] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:15.700183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:15.710638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaf9e8-d58f-470a-a6d2-7805d981f93d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:15.714559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:15.715166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:15.715481 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:15.715758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:15.777062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:15.778501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50db658-3aaf-4b0c-86eb-1b34df633984 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:15.787620 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1303/2593] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:18.573552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:18.639697 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4247-c132-4f0d-ba29-234ef1aa7d4c service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:18.644841 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:18.645787 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:18.646062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:18.646328 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] PATH_INFO: `/v3/users/4365daa0034444e2aa8e489c20b0e362` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:18.647509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4365daa0034444e2aa8e489c20b0e362)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:18.649430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:18.698952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4365daa0034444e2aa8e489c20b0e362'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:18.706326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4365daa0034444e2aa8e489c20b0e362'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:18.713985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4365daa0034444e2aa8e489c20b0e362'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:18.714591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4365daa0034444e2aa8e489c20b0e362'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:18.728012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4365daa0034444e2aa8e489c20b0e362'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:18.734313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1291/2594] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:18 2022] DELETE /identity/v3/users/4365daa0034444e2aa8e489c20b0e362 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:18.739034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:18.739589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:18.739589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:18.759852 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:18.761072 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:18.827771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1304/2595] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:18.838025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:18.839646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:18.900549 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b2e3-fd0a-438f-95da-00d67ee1f830 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:18.904682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:18.905292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:18.905569 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:18.905822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:18.913400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:18.916044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:18.917843 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:18.930582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1292/2596] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:19.211170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:19.212703 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:19.225808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf35d5-c901-47d8-8eec-bca485930ae5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:19.231795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:19.232436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:19.232708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:19.232971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] PATH_INFO: `/v3/projects/52f044956b2a49e69a089c4d3eb3e930` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:19.235126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f044956b2a49e69a089c4d3eb3e930)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:19.237119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:19.249637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:19.286410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f044956b2a49e69a089c4d3eb3e930', 'request_id': 'req-e45f9e69-823c-4b48-b63a-a6d343b4746e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.295790 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f044956b2a49e69a089c4d3eb3e930', 'request_id': 'req-e45f9e69-823c-4b48-b63a-a6d343b4746e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.309844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f044956b2a49e69a089c4d3eb3e930', 'request_id': 'req-e45f9e69-823c-4b48-b63a-a6d343b4746e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.321389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] The token cache is being invalidate because project 52f044956b2a49e69a089c4d3eb3e930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:19.321674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.322377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.323965 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1305/2597] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:19 2022] DELETE /identity/v3/projects/52f044956b2a49e69a089c4d3eb3e930 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:19.328165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:19.338331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eaaca-bf12-40f2-bf2f-a0466ee6637b service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:19.400010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:19.400628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:19.400904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:19.401175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] PATH_INFO: `/v3/users/24845e8d1e58448d9ee1df86a52bcca8` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:19.402350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24845e8d1e58448d9ee1df86a52bcca8)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:19.404332 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:19.453333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24845e8d1e58448d9ee1df86a52bcca8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.460662 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24845e8d1e58448d9ee1df86a52bcca8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.467376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24845e8d1e58448d9ee1df86a52bcca8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.467982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24845e8d1e58448d9ee1df86a52bcca8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.479454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7ef2035d-828f-4e5a-bba0-779199082b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24845e8d1e58448d9ee1df86a52bcca8'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.485211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1293/2598] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:19 2022] DELETE /identity/v3/users/24845e8d1e58448d9ee1df86a52bcca8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:19.765135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:19.766642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:19.780390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f9e69-823c-4b48-b63a-a6d343b4746e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:19.838119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:19.838749 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:19.839015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:19.839328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] PATH_INFO: `/v3/projects/d61ca4afcea54c6da7659d343d4a539f` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:19.840470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61ca4afcea54c6da7659d343d4a539f)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:19.842348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:19.891510 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61ca4afcea54c6da7659d343d4a539f', 'request_id': 'req-cb7b8131-322f-498c-94ee-8b12b21b522e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.898430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61ca4afcea54c6da7659d343d4a539f', 'request_id': 'req-cb7b8131-322f-498c-94ee-8b12b21b522e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.907046 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61ca4afcea54c6da7659d343d4a539f', 'request_id': 'req-cb7b8131-322f-498c-94ee-8b12b21b522e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.917609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] The token cache is being invalidate because project d61ca4afcea54c6da7659d343d4a539f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:19.917894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.918512 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cb7b8131-322f-498c-94ee-8b12b21b522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:19.920042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1306/2599] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:19 2022] DELETE /identity/v3/projects/d61ca4afcea54c6da7659d343d4a539f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:19.927219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:19.927702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:19.927811 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:19.952134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:19.953349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:20.015241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1294/2600] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:20.023463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.023750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.024024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.047430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:20.048624 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:20.057687 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1307/2601] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:20.064637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.080311 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed02af6-9569-4d89-b985-269dbdeb2c57 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.087963 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.088768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.089162 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.089485 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.090426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:20.090833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.093301 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.105889 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1295/2602] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:20.110519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.120054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badeb7b-dbdc-4944-85a1-9fa89d8c9a3a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.125411 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.126007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.126280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.126583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.127217 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.129255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.159097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1308/2603] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:20.163442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.168967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:20.176074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d9035-ebd1-4545-99d5-b07cf2066ae2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.236721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.237339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.237616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.237886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.238545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.240548 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.264461 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1296/2604] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:20.269089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.274915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:20.281480 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc38f84-2475-4d43-a34d-988e8165eb10 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.287752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.288347 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.288646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.288903 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.289543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.291128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.301605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1309/2605] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:22:20.305749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.316094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4c99-3e44-40a1-9e6e-80516f6a6790 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.321335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.321918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.322197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.322467 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.323108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.324737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de325fb-466e-4e8c-8cec-6f99b3a6ca9f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.336705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1297/2606] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:20.340814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.351397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045acd36-99a7-462c-96b0-7ea8f90de297 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.356820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.357465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.357742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.358011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] PATH_INFO: `/v3/projects/9b989caf63294272b5c8fd35eb6ab7b8/users/07b7781ff30e4b14829db7b534b89308/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.372938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b989caf63294272b5c8fd35eb6ab7b8, user_id=07b7781ff30e4b14829db7b534b89308, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.375665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.390000 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1310/2607] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:20 2022] PUT /identity/v3/projects/9b989caf63294272b5c8fd35eb6ab7b8/users/07b7781ff30e4b14829db7b534b89308/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:20.401838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688440e-6250-425e-beda-09269186d769 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.402119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688440e-6250-425e-beda-09269186d769 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.402389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688440e-6250-425e-beda-09269186d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.433499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e688440e-6250-425e-beda-09269186d769 None None] MFA Rules not processed for user `07b7781ff30e4b14829db7b534b89308`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:20.434721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e688440e-6250-425e-beda-09269186d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:20.511075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1298/2608] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:20.515841 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.585370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2b061-081e-4bed-827b-a4ca2e3ec565 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.590848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.591473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.591747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.592012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.592630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.594599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.623964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1311/2609] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:20.628209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688440e-6250-425e-beda-09269186d769 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.639132 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688440e-6250-425e-beda-09269186d769 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.701538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.702142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.702418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.702687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.703385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.705318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.724082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:20.730854 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1299/2610] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:20.734963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.750475 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631779bf-0970-4c78-999b-f50c920c43c8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.755361 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.755956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.756233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.756501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.757153 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.758728 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.769186 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1312/2611] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:20.773755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.784147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91595e1-a562-4699-a3d1-2e38153fa449 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.789474 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.790119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.790395 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.790663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] PATH_INFO: `/v3/projects/c2c7843b44d8482b8119d970487a74e1/users/97ac359543db4a5c814379db9fa3c5cc/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.806246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c7843b44d8482b8119d970487a74e1, user_id=97ac359543db4a5c814379db9fa3c5cc, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.808939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.824820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1300/2612] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:20 2022] PUT /identity/v3/projects/c2c7843b44d8482b8119d970487a74e1/users/97ac359543db4a5c814379db9fa3c5cc/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:20.831109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.845836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307732f-c81d-44c0-b92c-35ea42d5e8e8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.907367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.907988 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.908256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.908520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.909157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.910717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaadc78-c60d-41c2-90ec-35be1e4d594f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.920848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1313/2613] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:20.925280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:20.935806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132f555-2e25-4585-8cc6-067ec184db53 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:20.940995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:20.941642 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.941915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.942183 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] PATH_INFO: `/v3/projects/c2c7843b44d8482b8119d970487a74e1/users/97ac359543db4a5c814379db9fa3c5cc/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.944187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c7843b44d8482b8119d970487a74e1, user_id=97ac359543db4a5c814379db9fa3c5cc, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:20.946826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:20.957931 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1301/2614] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:20 2022] PUT /identity/v3/projects/c2c7843b44d8482b8119d970487a74e1/users/97ac359543db4a5c814379db9fa3c5cc/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:20.968252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:20.968540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:20.968811 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:20.997149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] MFA Rules not processed for user `97ac359543db4a5c814379db9fa3c5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:20.998351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:21.027088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:21.070997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1314/2615] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:21.082338 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:21.084449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:21.146834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d2019-e1b5-4c6c-9d16-18291960b003 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:21.150941 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:21.151625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:21.151884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:21.152180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:21.163203 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:21.164722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43e9d-fcd7-43d1-8bcc-9f7fe3f9a595 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:21.177339 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1302/2616] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:21.312527 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:21.378050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df88f-d3df-4dbe-b9c6-f6963df66c89 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:21.383304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:21.383928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:21.384208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:21.384478 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] PATH_INFO: `/v3/users/07b7781ff30e4b14829db7b534b89308` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:21.385609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b7781ff30e4b14829db7b534b89308)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:21.387583 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:21.437050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b7781ff30e4b14829db7b534b89308'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:21.437611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b7781ff30e4b14829db7b534b89308'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:21.438266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b7781ff30e4b14829db7b534b89308'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:21.446971 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b7781ff30e4b14829db7b534b89308'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:21.454092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b7781ff30e4b14829db7b534b89308'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:21.472846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1315/2617] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:21 2022] DELETE /identity/v3/users/07b7781ff30e4b14829db7b534b89308 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:21.479844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:21.480261 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:21.480602 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:21.507394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:21.508606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:21.572754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1303/2618] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:21.582645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:21.584354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:21.633486 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:21.647154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd84e2-bd09-4dc1-917b-bf70f7796696 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:21.651433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:21.652030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:21.652305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:21.652570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:21.661663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:21.663082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:21.672474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1316/2619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:21.949527 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:21.951059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:21.965500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b877513-5c07-4a6d-8486-18e9b09d7bf5 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:21.972199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:21.972907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:21.973191 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:21.973448 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] PATH_INFO: `/v3/projects/9b989caf63294272b5c8fd35eb6ab7b8` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:21.974690 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b989caf63294272b5c8fd35eb6ab7b8)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:21.976611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:22.031881 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b989caf63294272b5c8fd35eb6ab7b8', 'request_id': 'req-5c0bc826-7dd4-44f1-898c-7f021b9ac165'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.038198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b989caf63294272b5c8fd35eb6ab7b8', 'request_id': 'req-5c0bc826-7dd4-44f1-898c-7f021b9ac165'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.043290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:22.045043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b989caf63294272b5c8fd35eb6ab7b8', 'request_id': 'req-5c0bc826-7dd4-44f1-898c-7f021b9ac165'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.063352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] The token cache is being invalidate because project 9b989caf63294272b5c8fd35eb6ab7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:22.063638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.064290 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.066279 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1304/2620] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:21 2022] DELETE /identity/v3/projects/9b989caf63294272b5c8fd35eb6ab7b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:22.070444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:22.080365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b079-0695-4c49-a2f1-905fda6594b1 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:22.150280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:22.151260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.151599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.151972 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] PATH_INFO: `/v3/users/97ac359543db4a5c814379db9fa3c5cc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.153915 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ac359543db4a5c814379db9fa3c5cc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:22.156962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:22.206124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ac359543db4a5c814379db9fa3c5cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.206760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ac359543db4a5c814379db9fa3c5cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.207389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ac359543db4a5c814379db9fa3c5cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.216297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ac359543db4a5c814379db9fa3c5cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.223626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4f860886-9eb3-45dd-9719-8d502a24685f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ac359543db4a5c814379db9fa3c5cc'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.241775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1317/2621] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:22 2022] DELETE /identity/v3/users/97ac359543db4a5c814379db9fa3c5cc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:22:22.519243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:22.521161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:22.534791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bc826-7dd4-44f1-898c-7f021b9ac165 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:22.601663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:22.602210 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.602490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.602764 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] PATH_INFO: `/v3/projects/c2c7843b44d8482b8119d970487a74e1` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.603932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c7843b44d8482b8119d970487a74e1)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:22.605903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:22.657519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c7843b44d8482b8119d970487a74e1', 'request_id': 'req-c207fae7-be77-464e-82ac-82c7ce5f32ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.663729 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c7843b44d8482b8119d970487a74e1', 'request_id': 'req-c207fae7-be77-464e-82ac-82c7ce5f32ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.669754 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c7843b44d8482b8119d970487a74e1', 'request_id': 'req-c207fae7-be77-464e-82ac-82c7ce5f32ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.684641 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] The token cache is being invalidate because project c2c7843b44d8482b8119d970487a74e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:22.684943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.685558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c207fae7-be77-464e-82ac-82c7ce5f32ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:22.687061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1305/2622] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:22 2022] DELETE /identity/v3/projects/c2c7843b44d8482b8119d970487a74e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:22.692215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.692501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.692775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.712370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:22.713582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:22.776070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1318/2623] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:22.784389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.784668 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.785032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.806155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:22.807456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:22.816545 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1306/2624] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:22.821004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:22.827386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:22.831587 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59822131-fec0-4557-9f90-be32ba72a4eb None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:22.837768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:22.838458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.838744 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.839038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.839741 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:22.840050 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:22.842024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:22.854244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1319/2625] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:22:22.858560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:22.868120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a26d3-df67-4144-864f-663f3bbf8343 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:22.872966 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:22.873560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.873838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.874107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.874733 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:22.876772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:22.913065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1307/2626] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:22 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:22.917646 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:22.928098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a7dc-d35a-4be1-9a0c-42ddaaea58a1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:22.988082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:22.988693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:22.989003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:22.989273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:22.989913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:22.992024 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.019959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1320/2627] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:22 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:23.026747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.039544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136c45f-07cb-4bee-9c13-8ce40baf5567 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.045003 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.045571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.045877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.046143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.046786 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.048486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.060051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1308/2628] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:23.064253 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.074501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601b53-9c65-4ad4-9e49-a9939da97a68 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.079303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.079898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.080176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.080448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.081094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.082690 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ce830-b7de-4254-9abf-7f5386b89490 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.093382 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1321/2629] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:23.097716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.108077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199f8e-5445-4365-8e0d-0e3a374bbd61 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.113259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.113908 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.114187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.114449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] PATH_INFO: `/v3/projects/fe8c333075044d7a894c5d0e7db07bed/users/13866e0bdac54dfab61f3c1ea3bcdb6e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.128882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8c333075044d7a894c5d0e7db07bed, user_id=13866e0bdac54dfab61f3c1ea3bcdb6e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.131605 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.146656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1309/2630] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:23 2022] PUT /identity/v3/projects/fe8c333075044d7a894c5d0e7db07bed/users/13866e0bdac54dfab61f3c1ea3bcdb6e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:23.157999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.158284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.158556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.186966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] MFA Rules not processed for user `13866e0bdac54dfab61f3c1ea3bcdb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:23.188265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:23.254605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1322/2631] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:23.259472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.278430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:23.329135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd13d25-ed17-4b04-b1b1-ca4a8ce96257 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.334459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.335068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.335378 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.335652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.336284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.338209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.367543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1310/2632] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:23.371773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.382337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2353cc-b54d-45a3-a3e0-0176d965785c None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.441015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.441628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.441901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.442172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.442812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.444798 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.452822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:23.466821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1323/2633] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:23 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:23.470875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.481348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a43eb5-2418-41cd-8783-297b9c01b7c9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.486064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.486652 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.486926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.487212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.487857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.489455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.499833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1311/2634] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:23.504027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.514636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc15e1-2177-40af-8d14-14c3f0249373 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.520901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.521554 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.521804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.522098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] PATH_INFO: `/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a/users/7e389e9358ac4b829c239342415a1c9a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.537734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7d2c17e5ee4aa3978e80d743fa327a, user_id=7e389e9358ac4b829c239342415a1c9a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.540438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.555341 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1324/2635] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:23 2022] PUT /identity/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a/users/7e389e9358ac4b829c239342415a1c9a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:23.559975 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.571503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba853a50-ab0e-479f-819d-49cab58edfd4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.632972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.633525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.633803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.634073 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.634710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.636366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a25ee-5662-49ff-bde0-4f415b6b8862 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.646308 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1312/2636] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:23.650644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.661134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06352-f83a-49fb-8714-a9f38694b712 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.666018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.666658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.666929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.667224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] PATH_INFO: `/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a/users/7e389e9358ac4b829c239342415a1c9a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.669261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7d2c17e5ee4aa3978e80d743fa327a, user_id=7e389e9358ac4b829c239342415a1c9a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.671890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.681990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1325/2637] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:23 2022] PUT /identity/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a/users/7e389e9358ac4b829c239342415a1c9a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:23.692555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.692838 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.693111 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.730021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] MFA Rules not processed for user `7e389e9358ac4b829c239342415a1c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:23.731268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:23.812469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1313/2638] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:23.824568 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:23.826689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:23.896160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964016-fdfb-4c4f-82a0-c8e3eed33494 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:23.900644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:23.901258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:23.901536 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:23.901806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:23.960278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:23.961727 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba4fe0-f0f4-4994-a4a3-d4957619b710 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:23.971115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1326/2639] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:26.548925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:26.562336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:26.615810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb31f-3e51-47de-b2f8-a20e8e5e7306 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:26.620558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:26.621185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:26.621458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:26.621726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] PATH_INFO: `/v3/users/13866e0bdac54dfab61f3c1ea3bcdb6e` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:26.622860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13866e0bdac54dfab61f3c1ea3bcdb6e)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:26.624856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:26.675285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13866e0bdac54dfab61f3c1ea3bcdb6e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:26.683667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13866e0bdac54dfab61f3c1ea3bcdb6e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:26.691611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13866e0bdac54dfab61f3c1ea3bcdb6e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:26.692327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13866e0bdac54dfab61f3c1ea3bcdb6e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:26.705985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13866e0bdac54dfab61f3c1ea3bcdb6e'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:26.712832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1314/2640] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:26 2022] DELETE /identity/v3/users/13866e0bdac54dfab61f3c1ea3bcdb6e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:26.717502 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:26.718022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:26.718128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:26.737577 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:26.738810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:26.801450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1327/2641] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:26.811469 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:26.813165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:26.874029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffab5-f768-463f-9a39-9fa03e4e11f7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:26.878365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:26.878964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:26.879274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:26.879538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:26.889444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:26.890926 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:26.900715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1315/2642] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:22:27.186197 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:27.187754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:27.207531 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d4f3-4557-42cb-a980-378ce520f581 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:27.213644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:27.214357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:27.214725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:27.214995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] PATH_INFO: `/v3/projects/fe8c333075044d7a894c5d0e7db07bed` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:27.216151 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8c333075044d7a894c5d0e7db07bed)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:27.218231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:27.219936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:27.266525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8c333075044d7a894c5d0e7db07bed', 'request_id': 'req-face606d-6ed6-40cd-831b-9e75f22875a5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.273302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8c333075044d7a894c5d0e7db07bed', 'request_id': 'req-face606d-6ed6-40cd-831b-9e75f22875a5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.281373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8c333075044d7a894c5d0e7db07bed', 'request_id': 'req-face606d-6ed6-40cd-831b-9e75f22875a5'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.291557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] The token cache is being invalidate because project fe8c333075044d7a894c5d0e7db07bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:27.291842 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.292460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.293934 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1328/2643] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:27 2022] DELETE /identity/v3/projects/fe8c333075044d7a894c5d0e7db07bed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:27.298208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:27.308307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c212f-ac1b-4f60-9f59-d1519fce958e service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:27.340452 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:27.369611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:27.370239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:27.370516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:27.370896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] PATH_INFO: `/v3/users/7e389e9358ac4b829c239342415a1c9a` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:27.372179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e389e9358ac4b829c239342415a1c9a)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:27.374195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:27.429319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e389e9358ac4b829c239342415a1c9a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.440624 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e389e9358ac4b829c239342415a1c9a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.447875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e389e9358ac4b829c239342415a1c9a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.448517 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e389e9358ac4b829c239342415a1c9a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.460360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a48ccbe2-8094-437f-b7f9-7b2815df3021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e389e9358ac4b829c239342415a1c9a'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.467255 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1316/2644] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:27 2022] DELETE /identity/v3/users/7e389e9358ac4b829c239342415a1c9a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:27.736943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:27.738570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:27.751839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face606d-6ed6-40cd-831b-9e75f22875a5 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:27.817396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:27.817938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:27.818213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:27.818482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] PATH_INFO: `/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:27.819771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7d2c17e5ee4aa3978e80d743fa327a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:27.821699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:27.877495 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7d2c17e5ee4aa3978e80d743fa327a', 'request_id': 'req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.883968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7d2c17e5ee4aa3978e80d743fa327a', 'request_id': 'req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.893119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7d2c17e5ee4aa3978e80d743fa327a', 'request_id': 'req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.904996 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] The token cache is being invalidate because project 5d7d2c17e5ee4aa3978e80d743fa327a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:27.905262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.905966 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-cd23bae8-81d7-4eda-80e6-5ef4eba123d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:27.907630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1329/2645] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:27 2022] DELETE /identity/v3/projects/5d7d2c17e5ee4aa3978e80d743fa327a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:27.912615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:27.913081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:27.913213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:27.933120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:27.934324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:27.994324 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1317/2646] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:28.003599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.003914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.004182 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.024851 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:28.026062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:28.034291 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1330/2647] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:28.038574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.048399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0b6aa-c3be-4b23-bcae-58c0e7d1fdc9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.053810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.054419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.054704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.054978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.055674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:28.055982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.057603 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.070144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1318/2648] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:28.074236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.083925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484a80-d1de-4d55-b8ba-7e6234fc8038 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.089805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.090398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.090674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.090944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.091607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.093525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.108907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:28.131276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1331/2649] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:28 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:28.135646 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.146415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57e64-2671-4d6c-b9aa-bd517919a681 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.186365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:28.207518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.208122 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.208400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.208671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.209293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.211251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.233984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1319/2650] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:28 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:28.238233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.248372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2d13-547e-4831-b62f-8be2eae16612 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.253225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.253819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.254096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.254367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.255011 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.256634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.266902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1332/2651] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:28.271421 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.284721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a48a-3804-4dec-93a2-a0781e20107b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.289741 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.290334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.290613 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.290886 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.291604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.293209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f873-2bb6-4d09-acf1-8c3ec74c7cbb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.303919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1320/2652] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:28.308109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.318124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1b101-cb83-4983-ba51-dcfff22e6923 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.323544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.324120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.324397 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.324668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] PATH_INFO: `/v3/projects/96d3269a5dbd465095839f29b4ef575e/users/beeee46a804a4a648473ce345411560c/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.340590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d3269a5dbd465095839f29b4ef575e, user_id=beeee46a804a4a648473ce345411560c, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.343223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.358322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1333/2653] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:28 2022] PUT /identity/v3/projects/96d3269a5dbd465095839f29b4ef575e/users/beeee46a804a4a648473ce345411560c/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:28.368717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.369002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.369252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.398645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] MFA Rules not processed for user `beeee46a804a4a648473ce345411560c`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:28.399916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:28.468060 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1321/2654] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:28.479276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:28.481371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:28.541092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ceba8-e0f4-48e5-8d56-18b00b7a6a1c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:28.546162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:28.546773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:28.547095 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:28.547405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:28.557832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:28.559316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db47a-f62e-4d03-8a8c-ef717a34f338 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:28.568962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1334/2655] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:31.659891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:31.726372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1fd4f-f46e-46d6-89cd-358380e0537c None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:31.731455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:31.732106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:31.732384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:31.732655 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] PATH_INFO: `/v3/users/beeee46a804a4a648473ce345411560c` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:31.733812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beeee46a804a4a648473ce345411560c)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:31.735817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:31.785872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beeee46a804a4a648473ce345411560c'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:31.788542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:31.794424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beeee46a804a4a648473ce345411560c'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:31.803002 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beeee46a804a4a648473ce345411560c'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:31.803683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beeee46a804a4a648473ce345411560c'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:31.816024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beeee46a804a4a648473ce345411560c'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:31.822292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1322/2656] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:31 2022] DELETE /identity/v3/users/beeee46a804a4a648473ce345411560c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:31.827052 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:31.827557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:31.827673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:31.846935 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:31.848179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:31.919305 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1335/2657] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:31.929316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:31.930923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:31.989392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea3345-874e-4d76-ba4f-58a6bfdada61 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:31.993857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:31.994457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:31.994734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:31.994976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.004411 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.005846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56993f8-6116-4e4c-8a28-b8fdc6c1fea6 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.015084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1323/2658] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:32.297449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.298885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:32.312377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f7529-1d39-42aa-94ea-08c1d35779a4 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.318139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.318782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.319087 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.319391 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] PATH_INFO: `/v3/projects/96d3269a5dbd465095839f29b4ef575e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.320712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d3269a5dbd465095839f29b4ef575e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.322559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.374888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d3269a5dbd465095839f29b4ef575e', 'request_id': 'req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:32.383047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d3269a5dbd465095839f29b4ef575e', 'request_id': 'req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:32.385275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:32.394171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d3269a5dbd465095839f29b4ef575e', 'request_id': 'req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:32.405864 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] The token cache is being invalidate because project 96d3269a5dbd465095839f29b4ef575e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:32.406178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:32.406902 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-5914bbfb-73c6-46f1-a1cb-c3b1a486b49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:32.408623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1336/2659] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:32 2022] DELETE /identity/v3/projects/96d3269a5dbd465095839f29b4ef575e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:32.413389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.413659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.413945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.435236 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:32.436416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:32.504286 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1324/2660] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:32.505997 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.506292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.506566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.528385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:32.529602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:32.538319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1337/2661] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:32.542858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.554403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccb387-cfa0-46ec-8811-d41476f651a2 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.559751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.560367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.560770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.561009 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.561702 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:32.561992 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.564090 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.576377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1325/2662] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:32.580612 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.591630 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512eca3-517e-4e2c-b721-2464cda2f31f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.597992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.598601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.598872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.599134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.599802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.601681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.631686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1338/2663] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:32.635888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.646331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c109178-304b-4b67-9dfc-86a3baea9c7e admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.697293 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:32.703800 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.704417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.704705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.704985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.705632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.707972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.732591 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1326/2664] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:32 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:32.736773 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.747329 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d148-3b00-4f3a-af60-3330b838de69 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.752602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.753203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.753479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.753753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.754398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.756023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.766112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1339/2665] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:32.770557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.781586 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734e7f5-dce6-4c3c-ba92-ad60f7934660 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.787144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.787772 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.788048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.788316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.788958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.790575 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a844-0aea-4d88-802f-242d4574c6c2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.801564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1327/2666] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:32.807738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.819782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfa26c-6681-4416-8bdc-1623755baeb9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:32.825150 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:32.825793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.826069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.826336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] PATH_INFO: `/v3/projects/84b5977606bd4cc68562ef336c7d5f92/users/5b98962c1c3540d8be3eaa4843fb9539/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.847124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b5977606bd4cc68562ef336c7d5f92, user_id=5b98962c1c3540d8be3eaa4843fb9539, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:32.850193 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:32.865958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1340/2667] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:32 2022] PUT /identity/v3/projects/84b5977606bd4cc68562ef336c7d5f92/users/5b98962c1c3540d8be3eaa4843fb9539/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:32.877890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:32.878423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:32.878423 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:32.910384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] MFA Rules not processed for user `5b98962c1c3540d8be3eaa4843fb9539`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:32.911742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:32.983637 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1328/2668] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:32.994854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:32.996822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:33.084730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c30cfe-9220-4780-9393-51af7bcc4a47 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:33.090387 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:33.091201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:33.091692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:33.092008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:33.107210 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:33.109286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae359b49-0652-4689-b745-bdab56e185f3 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:33.119133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1341/2669] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:42.979506 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:43.114627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=57 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:43.166126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:43.233145 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b817b-7156-4bd1-9eac-1cd2da0cc85b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:43.238215 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:43.239560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:43.240258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:43.240755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] PATH_INFO: `/v3/users/5b98962c1c3540d8be3eaa4843fb9539` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:43.241933 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b98962c1c3540d8be3eaa4843fb9539)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:43.243979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:43.299397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b98962c1c3540d8be3eaa4843fb9539'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.309135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b98962c1c3540d8be3eaa4843fb9539'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.317048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b98962c1c3540d8be3eaa4843fb9539'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.317695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b98962c1c3540d8be3eaa4843fb9539'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.329365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b98962c1c3540d8be3eaa4843fb9539'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.335366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1329/2670] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:43 2022] DELETE /identity/v3/users/5b98962c1c3540d8be3eaa4843fb9539 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:43.340027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:43.340307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:43.340579 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:43.360509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:43.361715 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:43.426434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1342/2671] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:43.438999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:43.440757 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:43.499573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332c23b-b3bf-40b8-aeae-8588c1871747 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:43.503470 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:43.504077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:43.504354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:43.504634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:43.514391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:43.515913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc813536-f956-4a7d-b94b-c6bc576b808f service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:43.526161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1330/2672] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:43.792101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:43.793627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:43.808022 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac4dba-871e-43a0-911c-875ded4e93bc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:43.813984 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:43.814702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:43.815044 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:43.815413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] PATH_INFO: `/v3/projects/84b5977606bd4cc68562ef336c7d5f92` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:43.816674 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b5977606bd4cc68562ef336c7d5f92)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:43.818643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:43.869578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b5977606bd4cc68562ef336c7d5f92', 'request_id': 'req-f1f86deb-4404-4867-9e5d-07e7c1e45e92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.875953 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b5977606bd4cc68562ef336c7d5f92', 'request_id': 'req-f1f86deb-4404-4867-9e5d-07e7c1e45e92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.885199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b5977606bd4cc68562ef336c7d5f92', 'request_id': 'req-f1f86deb-4404-4867-9e5d-07e7c1e45e92'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.897631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] The token cache is being invalidate because project 84b5977606bd4cc68562ef336c7d5f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:43.897947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.898566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-f1f86deb-4404-4867-9e5d-07e7c1e45e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:43.900138 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1343/2673] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:43 2022] DELETE /identity/v3/projects/84b5977606bd4cc68562ef336c7d5f92 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:43.905606 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821ba7-0379-4595-b514-10d703589305 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:43.905984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821ba7-0379-4595-b514-10d703589305 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:43.906258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821ba7-0379-4595-b514-10d703589305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:43.926864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6c821ba7-0379-4595-b514-10d703589305 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:43.928039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6c821ba7-0379-4595-b514-10d703589305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:43.946108 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:44.003041 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1331/2674] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:44.004807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.005120 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.005390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.026963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:44.028219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:44.036473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1344/2675] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:44.040897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c821ba7-0379-4595-b514-10d703589305 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.051256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c821ba7-0379-4595-b514-10d703589305 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.056102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.056709 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.056987 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.057256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.057914 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:44.058212 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.059859 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.071822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1332/2676] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:44.076681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.086889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf5d1-9415-47ed-813f-2bf45eed5dbc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.092929 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.093570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.093846 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.094240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.094885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.096885 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.127265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1345/2677] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:44 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:44.129790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.140180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0d916-eefe-4939-a6b4-9d27ead2905c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.209465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.210249 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.210627 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.210910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.211594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.213547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.235765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1333/2678] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:44 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:44.240560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.251244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4bbb3-b6f9-4d43-85fb-cb76290ad43b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.256820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.257427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.257705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.257974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.258618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.260304 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.396946 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1346/2679] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:22:44.401043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.411274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da0c70-a015-4776-9ea1-a220d3c61876 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.416238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.416836 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.417121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.417394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.418039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.419693 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cbce0-49c0-48b6-9afe-2495e5e1dcca admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.430490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1334/2680] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:44.435270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.445509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542652f5-5deb-424b-b92b-8fb5c241f5af admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.451097 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.451780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.452051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.452315 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] PATH_INFO: `/v3/projects/6ad0d20285794aef8df806d66baf9931/users/775e3255677849c3a3b2122b936b4d7e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.468123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad0d20285794aef8df806d66baf9931, user_id=775e3255677849c3a3b2122b936b4d7e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.470823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.494395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1347/2681] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:44 2022] PUT /identity/v3/projects/6ad0d20285794aef8df806d66baf9931/users/775e3255677849c3a3b2122b936b4d7e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:44.499505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930748c-eaba-4fa6-bc02-4c30b217d6c5 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.499807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930748c-eaba-4fa6-bc02-4c30b217d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.500125 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930748c-eaba-4fa6-bc02-4c30b217d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.518950 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f930748c-eaba-4fa6-bc02-4c30b217d6c5 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:44.520490 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f930748c-eaba-4fa6-bc02-4c30b217d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:44.593439 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1335/2682] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:44.610716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:44.613343 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:44.638017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:44.683118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51cf4-dbee-41a6-a759-51b662c7b1a4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:44.687716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:44.688559 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:44.689061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:44.689446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:44.699168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:44.700642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:44.710105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1348/2683] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:48.941712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:48.942167 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:48.942379 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:48.977669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] MFA Rules not processed for user `775e3255677849c3a3b2122b936b4d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:48.979047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:49.002416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:49.069078 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1336/2684] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:49.069924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.092396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb956-2f27-43db-92ca-63646fc314ff service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.104794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.106711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.107346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.107932 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.108889 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.110788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.158284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1349/2685] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:49 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:49.162726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.176398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d1aa-4424-485d-9881-86757d4b0a27 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.201195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.254932 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.255587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.255867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.256144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.256780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.258853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.278425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e730d0-6490-45ca-a22d-9130e2a93e59 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.282485 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.283105 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.283418 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.283681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.283916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1337/2686] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:49 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:49.285994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:49.287768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.298054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808c18-75c2-4087-ab19-882af70fe07f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.298740 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.300222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.303928 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.304738 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.304935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.305190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.305821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.307465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.312570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1350/2687] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:22:49.320596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1338/2688] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:49.323161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.333683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad1a00-416f-4ea2-83b0-c51ff91d1b1d service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.338288 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.338945 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.339244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.339514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] PATH_INFO: `/v3/projects/e4b186a486764d17a9dfa8899da127e9/users/0408275899c44464bfb9861f818f25a4/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.358185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b186a486764d17a9dfa8899da127e9, user_id=0408275899c44464bfb9861f818f25a4, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.361235 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.376755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1351/2689] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:49 2022] PUT /identity/v3/projects/e4b186a486764d17a9dfa8899da127e9/users/0408275899c44464bfb9861f818f25a4/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:49.380598 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.393416 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af1d8-7395-4f00-a0d4-b6d825c76c43 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.461077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.461701 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.461981 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.462254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.462907 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.464587 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.476417 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1339/2690] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:49.480700 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:49.492101 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ade3a-fdea-45e6-a34e-203177e29946 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:49.496795 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:49.497812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:49.497812 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:49.498025 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] PATH_INFO: `/v3/projects/e4b186a486764d17a9dfa8899da127e9/users/0408275899c44464bfb9861f818f25a4/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:49.500100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b186a486764d17a9dfa8899da127e9, user_id=0408275899c44464bfb9861f818f25a4, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:49.502845 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:49.514717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1352/2691] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:49 2022] PUT /identity/v3/projects/e4b186a486764d17a9dfa8899da127e9/users/0408275899c44464bfb9861f818f25a4/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:53.928897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:53.930835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:53.953783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317de5b-3260-4290-9596-07cbd8816fc9 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:54.002600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:54.035974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:54.036625 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.037045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.037320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] PATH_INFO: `/v3/users/1684906668f04bc985e21078d9057371` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.038493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1684906668f04bc985e21078d9057371)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:54.040489 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:54.099755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1684906668f04bc985e21078d9057371'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.113147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1684906668f04bc985e21078d9057371'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.121731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1684906668f04bc985e21078d9057371'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.122559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1684906668f04bc985e21078d9057371'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.140972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1e94aa5-a4ee-4531-b984-3d1fa283e434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1684906668f04bc985e21078d9057371'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.149614 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1340/2692] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:53 2022] DELETE /identity/v3/users/1684906668f04bc985e21078d9057371 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:54.402528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:54.404609 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:54.423029 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac958e7-26f1-4f3d-ba5a-734bf867be5c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:54.492772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:54.493448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.494395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.494742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] PATH_INFO: `/v3/projects/5f178f6dad7e4661b5f456339385b329` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.495991 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f178f6dad7e4661b5f456339385b329)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:54.498016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:54.510353 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:54.561833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f178f6dad7e4661b5f456339385b329', 'request_id': 'req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.569906 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f178f6dad7e4661b5f456339385b329', 'request_id': 'req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.580028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f178f6dad7e4661b5f456339385b329', 'request_id': 'req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.595679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] The token cache is being invalidate because project 5f178f6dad7e4661b5f456339385b329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:54.596265 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.596954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-60bae32d-f98b-4fbe-8a7f-dc2d1e6357a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:54.599373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1353/2693] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:54 2022] DELETE /identity/v3/projects/5f178f6dad7e4661b5f456339385b329 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:54.605070 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.606365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.606700 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.636735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:54.638830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:54.713010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1341/2694] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:54.722063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.723039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.723380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.746299 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:54.747822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:54.756200 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1354/2695] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:54.760392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:54.771283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a259d1a-901b-4689-9125-08cd6791be80 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:54.776675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:54.777640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.777640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.777929 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.778514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:54.778823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:54.780923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:54.793649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1342/2696] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:22:54.798092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:54.808580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4faf28-a245-4ad0-97a9-8626d46e0600 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:54.814331 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:54.814967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.815295 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.815569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.816223 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:54.818196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:54.851757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1355/2697] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:54 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:54.855922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:54.869945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9174d-35a8-40c5-b140-21623c9dc10c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:54.931996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:54.958449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:54.958870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:54.959538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:54.959827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:54.960482 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:54.962667 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:54.996721 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1343/2698] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:54 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:54.997976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:55.015264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964f5f-2674-415e-9b1b-0317f7c546c2 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:55.022449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:55.023076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.023379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.023650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.024293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:55.026048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:55.041142 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1356/2699] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:55.043375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:55.057109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2d0a-5227-43ae-8ab7-172be05668ee admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:55.062880 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:55.063674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.063955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.064224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.065019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:55.066665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753fcbf-2fa8-4c23-8165-9ebdc0aa5383 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:55.082996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1344/2700] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:55.084412 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:55.096614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be678-a85a-497d-a97f-8fb126beac1d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:55.104276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:55.104532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.105060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.105406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] PATH_INFO: `/v3/projects/e0ea3c3e66224d508afef841de5b8d61/users/1f0e2c34b857446d826879a25866aae7/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.128598 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ea3c3e66224d508afef841de5b8d61, user_id=1f0e2c34b857446d826879a25866aae7, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:55.131807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070c288-3d85-4539-ae6f-e3907501415f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:55.152665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1357/2701] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:55 2022] PUT /identity/v3/projects/e0ea3c3e66224d508afef841de5b8d61/users/1f0e2c34b857446d826879a25866aae7/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:55.162971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.163659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.164257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.202705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] MFA Rules not processed for user `1f0e2c34b857446d826879a25866aae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:55.204570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.328515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.328854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.329116 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.339390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1345/2702] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:22:55.353194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:55.354224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.374164 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] MFA Rules not processed for user `0408275899c44464bfb9861f818f25a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:55.375758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.475790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6683f-02f1-4ab2-a4f6-82e8fde67fea None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:55.476354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1358/2703] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:55.487091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:55.487858 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.488067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.489254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:55.490010 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.491227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.498687 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:55.500403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e928-b03d-4e6c-b61b-504b6ed985d3 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:55.510958 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1346/2704] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:22:55.513005 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:55.559065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf78e3-ccc3-415d-b306-fd17c81f4bc5 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:55.564107 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:55.564723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.564992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.565260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.567219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.649012 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:55.651298 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:55.663826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1359/2705] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:22:55.837974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:55.838230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:55.838312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:55.868437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:55.869400 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:55.885223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:55.973052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1347/2706] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:56.044925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:56.046437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:56.127457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a98186-8ead-44a9-b555-503f3b2b3f25 service glance] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:56.132320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:56.132944 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:56.133218 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:56.133488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:56.142446 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:56.144241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39cf0f-1bbf-4670-b2ff-47e291307cf1 service swift] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:56.156803 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1360/2707] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:22:58.395804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:58.467999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc84917-0497-4a01-b189-1f06d90d27b8 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:58.476920 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:58.477621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:58.477898 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:58.478171 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] PATH_INFO: `/v3/users/1f0e2c34b857446d826879a25866aae7` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:58.479385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0e2c34b857446d826879a25866aae7)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:58.481568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:58.544089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0e2c34b857446d826879a25866aae7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:58.556868 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0e2c34b857446d826879a25866aae7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:58.565224 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0e2c34b857446d826879a25866aae7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:58.565960 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0e2c34b857446d826879a25866aae7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:58.591501 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0e2c34b857446d826879a25866aae7'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:58.598560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1348/2708] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:22:58 2022] DELETE /identity/v3/users/1f0e2c34b857446d826879a25866aae7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:58.603522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:58.604064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:58.604064 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:58.626739 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:58.627664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:58.700958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1361/2709] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:58.711135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:58.715042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:58.781529 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:58.799025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f22c9-10e8-4b93-84ea-f179edf48b54 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:58.803016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:58.803487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:58.803742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:58.804008 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:58.814228 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:58.815851 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9b320-0265-40ce-9aeb-7c0b948339bc service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:58.826840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1349/2710] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:22:59.141246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.143325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:59.156625 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=100 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:22:59.163586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a0013-16bc-42ca-b406-3b5533103b96 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.169472 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.170489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.170833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.171132 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] PATH_INFO: `/v3/projects/e0ea3c3e66224d508afef841de5b8d61` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.172578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ea3c3e66224d508afef841de5b8d61)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.174518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.242547 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ea3c3e66224d508afef841de5b8d61', 'request_id': 'req-c2d9abdd-537e-4903-98d6-586844efc5ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:59.249565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ea3c3e66224d508afef841de5b8d61', 'request_id': 'req-c2d9abdd-537e-4903-98d6-586844efc5ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:59.260872 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ea3c3e66224d508afef841de5b8d61', 'request_id': 'req-c2d9abdd-537e-4903-98d6-586844efc5ce'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:59.280224 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] The token cache is being invalidate because project e0ea3c3e66224d508afef841de5b8d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:22:59.280738 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:59.281416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2d9abdd-537e-4903-98d6-586844efc5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:22:59.282920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1362/2711] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:22:59 2022] DELETE /identity/v3/projects/e0ea3c3e66224d508afef841de5b8d61 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:22:59.288365 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.288925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.289391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.317418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:59.318746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:59.430032 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1350/2712] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:59.441561 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.442124 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.442519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.470266 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:59.471580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:22:59.480085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1363/2713] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:22:59.484181 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.494713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e878ed-0cb9-4989-b161-038305d849e2 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.499604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.500449 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.500804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.501139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.501861 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:22:59.502231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.504161 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.521491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1351/2714] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:22:59.525857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.543927 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049c7c6-0444-4edc-b0a8-9ce0c51aa2a2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.552936 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.553888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.554237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.554603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.555390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.557399 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.599102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1364/2715] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:22:59 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:22:59.600000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.613724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30424562-c109-4991-b602-e8563293f6bb admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.713254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.713864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.714142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.714497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.715216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.717158 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.750257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1352/2716] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:22:59 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:22:59.753522 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.764992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bea82c-4024-468d-a795-41a5766be75e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.774816 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.775532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.775804 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.776076 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.776970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.785614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.803893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1365/2717] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:22:59.804853 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.816618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c9b36-4301-4c68-81ae-312d5be5c7a1 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.821691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.822538 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.822823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.823091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.823797 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.825430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11a279-96f9-4476-9447-74a553e2cbf8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.842969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1353/2718] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:22:59.848198 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:22:59.863135 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b87c-a000-4c47-b5b7-efdcda00b1e9 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:22:59.868045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:22:59.868709 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.869033 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.869316 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] PATH_INFO: `/v3/projects/80a8759090164304818152db13815916/users/612318f1bfe241f792fd1c64581c861e/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.889083 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a8759090164304818152db13815916, user_id=612318f1bfe241f792fd1c64581c861e, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:22:59.894575 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:22:59.919436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1366/2719] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:22:59 2022] PUT /identity/v3/projects/80a8759090164304818152db13815916/users/612318f1bfe241f792fd1c64581c861e/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:22:59.923751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340409d-1cf8-457d-9c08-51ba5c0a3786 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:22:59.924285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340409d-1cf8-457d-9c08-51ba5c0a3786 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:22:59.924672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340409d-1cf8-457d-9c08-51ba5c0a3786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:22:59.958164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-2340409d-1cf8-457d-9c08-51ba5c0a3786 None None] MFA Rules not processed for user `612318f1bfe241f792fd1c64581c861e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:22:59.959477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2340409d-1cf8-457d-9c08-51ba5c0a3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:00.005360 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:00.045472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1354/2720] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:00.057056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:00.059395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:00.133062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9b4c3-678b-4e20-b279-e11c3e6e6058 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:00.136793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:00.137406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:00.137684 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:00.137951 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:00.150723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:00.152219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0d92d-e489-4ba4-94d3-933bb288d1c9 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:00.161839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1367/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:04.953911 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:04.954427 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:04.954525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:04.975785 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] MFA Rules not processed for user `775e3255677849c3a3b2122b936b4d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:04.977022 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:05.035584 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1355/2722] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:07.009003 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:07.009546 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:07.009762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:07.030802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:07.032352 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:07.052207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:07.095018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1368/2723] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:23:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:07.107596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:07.109174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:07.181722 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7563c7-3b80-45e7-b8b6-dc46cd77091a None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:07.187340 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:07.188019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:07.188298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:07.188727 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:07.197262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:07.198945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352e6e6-72e2-4ae7-b3a9-63dee2e107d7 service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:07.208021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1356/2724] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:23:08.983713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:09.081613 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196443bd-307a-4203-b1ae-eb5494b06cdf None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:09.087564 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:09.088240 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.088523 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.089130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] PATH_INFO: `/v3/users/612318f1bfe241f792fd1c64581c861e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:09.090589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] RBAC: Authorizing `identity:delete_user(user_id=612318f1bfe241f792fd1c64581c861e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:09.092528 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:09.157843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612318f1bfe241f792fd1c64581c861e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.158511 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612318f1bfe241f792fd1c64581c861e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.159272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612318f1bfe241f792fd1c64581c861e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.172958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612318f1bfe241f792fd1c64581c861e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.195365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612318f1bfe241f792fd1c64581c861e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.228660 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1369/2725] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:08 2022] DELETE /identity/v3/users/612318f1bfe241f792fd1c64581c861e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:09.233320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.233808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.234129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:09.257648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:09.257648 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:09.324165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1357/2726] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:09.330998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:09.332506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:09.389723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:09.393998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba5f50-ae66-46c4-8262-a5a54456456e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:09.399788 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:09.400597 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.400942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.401363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:09.412270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:09.413830 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693fe86-590a-4a23-bd77-d00398dbb731 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:09.424157 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1370/2727] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 13:23:09.746040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:09.747888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:09.773351 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34583d88-884b-4366-a0e8-e344f0d9d2fb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:09.779708 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:09.780503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.780782 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.781052 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] PATH_INFO: `/v3/projects/80a8759090164304818152db13815916` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:09.783331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a8759090164304818152db13815916)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:09.785477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:09.794216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:09.848873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a8759090164304818152db13815916', 'request_id': 'req-f1b024f6-8d08-4524-a341-8e3ab941fdb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.855683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a8759090164304818152db13815916', 'request_id': 'req-f1b024f6-8d08-4524-a341-8e3ab941fdb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.862218 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a8759090164304818152db13815916', 'request_id': 'req-f1b024f6-8d08-4524-a341-8e3ab941fdb2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.877846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] The token cache is being invalidate because project 80a8759090164304818152db13815916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:09.878133 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.878821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-f1b024f6-8d08-4524-a341-8e3ab941fdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:09.880623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1358/2728] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:09 2022] DELETE /identity/v3/projects/80a8759090164304818152db13815916 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:09.886833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.887168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.887552 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:09.908814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:09.910092 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:09.971451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1371/2729] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:09.980241 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:09.980807 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:09.981089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.002428 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:10.003744 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:10.013671 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1359/2730] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:10.018550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.029048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780f13-38f1-4095-a2eb-2110ee73cf42 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.033848 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.034464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.034750 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.035023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.035717 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:10.036020 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.037634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.050212 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1372/2731] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:10.054522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.064476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2d498-71bb-47ca-b138-f58795d3b2df None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.069287 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.069923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.070226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.070494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.071120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.073062 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.104547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1360/2732] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:10.105691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.116623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fa84c-89d4-45c2-934a-98b02f70ca64 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.179146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.179785 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.180063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.180334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.180994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.182910 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.209339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1373/2733] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:10.210551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.222146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857abcb-7368-48ed-9906-0b8198c1045c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.229600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.230523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.231305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.231305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.232016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.233726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.248214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1361/2734] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:10.249689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.262125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926210a-758a-4d43-ad16-c7d1c7178892 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.267448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.268067 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.268349 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.268618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.269278 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.271395 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9274a-3f24-4747-abff-15fa50f4a801 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.287344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1374/2735] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:10.289771 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.302037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6752-e313-4614-b9ec-6971406ac05a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.307292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.307972 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.308266 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.308531 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] PATH_INFO: `/v3/projects/4857ab13dedb4c01861a0d3393acaf39/users/bf36c35b3c6b4a26b6df9de56a5597f8/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.326271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4857ab13dedb4c01861a0d3393acaf39, user_id=bf36c35b3c6b4a26b6df9de56a5597f8, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.329961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.345564 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1362/2736] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:10 2022] PUT /identity/v3/projects/4857ab13dedb4c01861a0d3393acaf39/users/bf36c35b3c6b4a26b6df9de56a5597f8/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:10.357725 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.358170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.358517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.390529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] MFA Rules not processed for user `bf36c35b3c6b4a26b6df9de56a5597f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:10.391890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:10.444199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:10.469190 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1375/2737] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:10.473778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.549399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86263c6-84ec-468a-9138-4a25438596b8 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.554265 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.554884 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.555157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.555454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.556084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.558024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.591399 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1363/2738] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/projects => generated 407 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:10.596228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.620699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14a6b-2380-4c5a-9158-7467e02790b0 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.681242 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.681863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.682136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.682403 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.683041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.685001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.711471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1376/2739] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/users => generated 310 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:23:10.713066 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.723885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27e0e3-b0f7-4d76-9cc0-7d9eae2be3b5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.728585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.729199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.729478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.729750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.730426 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.732193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.747093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1364/2740] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:10.749692 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.760435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4346ed-86d4-48f3-abe1-f632b3b8cfa6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.765434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.766214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.766569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.766981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] PATH_INFO: `/v3/projects/76c87cebfeb74aee8df48d483a14d75d/users/d878b6de59b7469f81ecab1ea09038d9/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.784800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c87cebfeb74aee8df48d483a14d75d, user_id=d878b6de59b7469f81ecab1ea09038d9, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.787514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.804515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1377/2741] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:10 2022] PUT /identity/v3/projects/76c87cebfeb74aee8df48d483a14d75d/users/d878b6de59b7469f81ecab1ea09038d9/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:10.808585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.815302 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:10.818971 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea9dc2-b3b8-4707-8a24-36182cb6d792 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.891295 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.891904 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.892176 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.892597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.893237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.895155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6e12a-ec6f-4c65-9ec9-70ca9011769a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.905876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1365/2742] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:10.910354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:10.921062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43335e51-d959-413a-9f33-30f1075871aa admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:10.925918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:10.926585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.926894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.927114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] PATH_INFO: `/v3/projects/76c87cebfeb74aee8df48d483a14d75d/users/d878b6de59b7469f81ecab1ea09038d9/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.929080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c87cebfeb74aee8df48d483a14d75d, user_id=d878b6de59b7469f81ecab1ea09038d9, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:10.931759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:10.943463 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1378/2743] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:10 2022] PUT /identity/v3/projects/76c87cebfeb74aee8df48d483a14d75d/users/d878b6de59b7469f81ecab1ea09038d9/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:10.953961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:10.954251 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:10.954532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:10.984993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] MFA Rules not processed for user `d878b6de59b7469f81ecab1ea09038d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:10.986355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:11.060165 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1366/2744] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:11.071351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:11.074230 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:11.138705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c047836-bb08-47f5-9b6f-1bd746851b9b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:11.142501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:11.143114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:11.143434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:11.143705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:11.153893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:11.155439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:11.165607 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1379/2745] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:11.331683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:11.342258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919194a-e686-4c4a-9382-0645d18a30ca None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:11.346335 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:11.347030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:11.347471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:11.347752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:11.409072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:11.410580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdfbb0-e931-481c-b1ef-6c3e03b09c29 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:11.421164 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1367/2746] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:16.851982 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:16.896572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:16.914655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ee26-dd55-4a66-bb7b-c84562ee2622 service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:16.919202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:16.919839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:16.920112 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:16.920420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] PATH_INFO: `/v3/users/bf36c35b3c6b4a26b6df9de56a5597f8` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:16.921557 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf36c35b3c6b4a26b6df9de56a5597f8)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:16.923491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:16.981310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf36c35b3c6b4a26b6df9de56a5597f8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:16.982010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf36c35b3c6b4a26b6df9de56a5597f8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:16.982626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf36c35b3c6b4a26b6df9de56a5597f8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:16.991143 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf36c35b3c6b4a26b6df9de56a5597f8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:16.998245 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf36c35b3c6b4a26b6df9de56a5597f8'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.015769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1380/2747] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:16 2022] DELETE /identity/v3/users/bf36c35b3c6b4a26b6df9de56a5597f8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:17.023038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:17.023940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:17.023940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:17.045984 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:17.047229 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:17.066628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:17.113211 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1368/2748] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:17.124231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:17.125724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:17.183213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e99a-399d-40bb-88b2-1e2f5a37767c admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:17.186774 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:17.187404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:17.187677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:17.187943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:17.196900 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:17.198307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:17.207605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1381/2749] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:17.521704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:17.523138 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:17.535749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4caed-018e-4c7a-8a54-9faeaea4d996 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:17.542169 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:17.542915 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:17.543119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:17.543413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] PATH_INFO: `/v3/projects/4857ab13dedb4c01861a0d3393acaf39` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:17.544596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4857ab13dedb4c01861a0d3393acaf39)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:17.547518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:17.600819 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4857ab13dedb4c01861a0d3393acaf39', 'request_id': 'req-ea28e170-2456-42fc-91e7-fc5335fc6858'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.607281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4857ab13dedb4c01861a0d3393acaf39', 'request_id': 'req-ea28e170-2456-42fc-91e7-fc5335fc6858'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.613982 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4857ab13dedb4c01861a0d3393acaf39', 'request_id': 'req-ea28e170-2456-42fc-91e7-fc5335fc6858'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.628350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] The token cache is being invalidate because project 4857ab13dedb4c01861a0d3393acaf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:17.628633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.629297 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.630826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1369/2750] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:17 2022] DELETE /identity/v3/projects/4857ab13dedb4c01861a0d3393acaf39 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:17.634826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:17.644515 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed431f-e711-4655-b31d-70d42957fd05 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:17.703742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:17.704373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:17.704656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:17.704928 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] PATH_INFO: `/v3/users/d878b6de59b7469f81ecab1ea09038d9` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:17.706204 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d878b6de59b7469f81ecab1ea09038d9)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:17.708201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:17.713008 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:17.758493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd878b6de59b7469f81ecab1ea09038d9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.759145 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd878b6de59b7469f81ecab1ea09038d9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.759765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd878b6de59b7469f81ecab1ea09038d9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.769634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd878b6de59b7469f81ecab1ea09038d9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.777482 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-72be0673-5bff-4818-8ca3-46dc87fc338e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd878b6de59b7469f81ecab1ea09038d9'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:17.795074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1382/2751] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:17 2022] DELETE /identity/v3/users/d878b6de59b7469f81ecab1ea09038d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:18.309683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.311280 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:18.326023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28e170-2456-42fc-91e7-fc5335fc6858 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.393780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.394424 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.394682 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.395337 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] PATH_INFO: `/v3/projects/76c87cebfeb74aee8df48d483a14d75d` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.396471 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c87cebfeb74aee8df48d483a14d75d)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.398392 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.446524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c87cebfeb74aee8df48d483a14d75d', 'request_id': 'req-3b7db18f-a8cc-4c51-992e-74925a4f4e16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:18.448626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:18.456129 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c87cebfeb74aee8df48d483a14d75d', 'request_id': 'req-3b7db18f-a8cc-4c51-992e-74925a4f4e16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:18.463536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c87cebfeb74aee8df48d483a14d75d', 'request_id': 'req-3b7db18f-a8cc-4c51-992e-74925a4f4e16'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:18.477967 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] The token cache is being invalidate because project 76c87cebfeb74aee8df48d483a14d75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:18.478268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:18.478895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-3b7db18f-a8cc-4c51-992e-74925a4f4e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:18.480458 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1370/2752] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:18 2022] DELETE /identity/v3/projects/76c87cebfeb74aee8df48d483a14d75d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:18.486246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.486772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.486882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.507719 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:18.509300 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:18.582919 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1383/2753] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:18.583961 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.584246 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.584518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.606568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:18.608596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:18.618457 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1371/2754] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:18.622455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.633427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319627d-2540-4817-a0e3-d7e621bf781f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.638681 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.639506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.639881 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.640351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.641099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:18.641466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.643406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.659369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1384/2755] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:18.661385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.671999 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a3688-fa65-429b-80a4-b694f958f648 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.677121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.677742 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.678065 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.678303 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.678924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.681309 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.713094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1372/2756] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:18 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:18.717030 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.728916 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee229-30d3-425a-b700-f4561fd3cb6b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.820043 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.820823 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.821167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.821444 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.822154 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.824572 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.845724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:18.855267 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.855702 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1385/2757] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:18 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:18.867082 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991d85-a73a-4fe4-95c2-3b9152e71d01 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.882879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.883669 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.884402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.884402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.885355 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.887071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.899000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1373/2758] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:18.903491 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.916246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a350-9507-4aee-b799-61af462f1e7a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.931484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.931484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.931484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.931484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.932281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.932281 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286a62-2f12-4611-82b7-0333e96edb52 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:18.938753 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1386/2759] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:18.943144 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:18.957135 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc647-b238-4b45-b8c4-46873c82e21f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:18.962187 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:18.962944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:18.963243 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:18.963515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] PATH_INFO: `/v3/projects/d64cace4d0304c3fa5ccb72c17e41327/users/8f9c58026e9c48bf98702fe39fd17fc2/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:18.981034 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64cace4d0304c3fa5ccb72c17e41327, user_id=8f9c58026e9c48bf98702fe39fd17fc2, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:18.983870 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:19.000059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1374/2760] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:18 2022] PUT /identity/v3/projects/d64cace4d0304c3fa5ccb72c17e41327/users/8f9c58026e9c48bf98702fe39fd17fc2/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:19.011863 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.012147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.012413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.044642 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] MFA Rules not processed for user `8f9c58026e9c48bf98702fe39fd17fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:19.045898 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:19.119118 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1387/2761] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:19.130855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:19.132629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:19.196487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e282c-e40f-4268-b25f-2138b2f55507 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:19.200197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:19.200805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.201081 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.201391 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.210263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:19.211659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b10707-09b0-4f08-9499-0c59e427d156 service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:19.220616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1375/2762] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:19.242327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:19.305839 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd527ad-ce5a-49e3-8fc0-fce8cf983d36 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:19.311196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:19.311950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.312131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.312393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] PATH_INFO: `/v3/users/8f9c58026e9c48bf98702fe39fd17fc2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.313618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9c58026e9c48bf98702fe39fd17fc2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:19.315742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:19.364274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9c58026e9c48bf98702fe39fd17fc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:19.364938 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9c58026e9c48bf98702fe39fd17fc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:19.365548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9c58026e9c48bf98702fe39fd17fc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:19.373999 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9c58026e9c48bf98702fe39fd17fc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:19.381970 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9c58026e9c48bf98702fe39fd17fc2'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:19.397574 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:19.403346 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1388/2763] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:19 2022] DELETE /identity/v3/users/8f9c58026e9c48bf98702fe39fd17fc2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:19.408540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.409105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.409214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.429285 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:19.430582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:19.494683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1376/2764] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:19.504594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:19.506588 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:19.591913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc773-af23-4b7e-a6a6-48478af642ad admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:19.595849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:19.596459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.596835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.597109 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.609141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:19.610670 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:19.621225 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1389/2765] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:19.929995 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:19.931532 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:19.944252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ea436-52a7-424e-a3e5-03de9b76e850 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:19.953397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:19.955639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:19.956109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:19.956382 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] PATH_INFO: `/v3/projects/d64cace4d0304c3fa5ccb72c17e41327` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:19.960691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64cace4d0304c3fa5ccb72c17e41327)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:19.964319 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:19.978899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:20.035536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64cace4d0304c3fa5ccb72c17e41327', 'request_id': 'req-65099905-091c-43da-bf9a-78d5405979b0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:20.041863 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64cace4d0304c3fa5ccb72c17e41327', 'request_id': 'req-65099905-091c-43da-bf9a-78d5405979b0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:20.047930 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64cace4d0304c3fa5ccb72c17e41327', 'request_id': 'req-65099905-091c-43da-bf9a-78d5405979b0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:20.062550 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] The token cache is being invalidate because project d64cace4d0304c3fa5ccb72c17e41327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:20.062813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:20.063520 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:20.065143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1377/2766] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:19 2022] DELETE /identity/v3/projects/d64cace4d0304c3fa5ccb72c17e41327 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:29.617354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=27 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:30.059443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:34.621419 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:34.630590 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe9441-86e7-4df9-887d-f51e3062d16e service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:34.662268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:34.663773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:34.682614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:34.683262 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:34.683540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:34.683810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:34.685979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:34.721574 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099905-091c-43da-bf9a-78d5405979b0 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:34.725153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:34.725761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:34.726039 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:34.726310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:34.728054 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:34.750922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:34.752435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:34.762059 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1390/2767] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:34.792640 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:34.794110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:34.804143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1378/2768] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:38.613947 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:38.616195 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:38.631541 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d53af-24fc-44e8-8e7e-391f13656761 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:38.641051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:38.641711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:38.642074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:38.642339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] PATH_INFO: `/v3/users/4b7f6d085f89478db97ef7da015932ef` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:38.643615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7f6d085f89478db97ef7da015932ef)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:38.645871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:38.698699 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7f6d085f89478db97ef7da015932ef'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:38.699363 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7f6d085f89478db97ef7da015932ef'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:38.699989 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7f6d085f89478db97ef7da015932ef'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:38.709213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7f6d085f89478db97ef7da015932ef'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:38.718322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2e83debb-e279-4927-b183-99a4db72d2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7f6d085f89478db97ef7da015932ef'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:38.735920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1391/2769] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:38 2022] DELETE /identity/v3/users/4b7f6d085f89478db97ef7da015932ef => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:39.075743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.087774 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcdd2b-5216-4cba-80e4-46d6c13a2169 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.180259 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.181377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.181713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.182011 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] PATH_INFO: `/v3/projects/ca3fd5b6d526471aa68dc7157adaa25d` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.189304 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3fd5b6d526471aa68dc7157adaa25d)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.193061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.249846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3fd5b6d526471aa68dc7157adaa25d', 'request_id': 'req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:39.252645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:39.257826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3fd5b6d526471aa68dc7157adaa25d', 'request_id': 'req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:39.264860 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3fd5b6d526471aa68dc7157adaa25d', 'request_id': 'req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:39.281746 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] The token cache is being invalidate because project ca3fd5b6d526471aa68dc7157adaa25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:39.282064 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:39.283006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-c75360fe-8b9c-42cc-859a-f1656ef7a4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:39.288154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1379/2770] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:39 2022] DELETE /identity/v3/projects/ca3fd5b6d526471aa68dc7157adaa25d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:39.289833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.290125 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.290394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.310549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:39.311939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:39.334891 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:39.401922 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1392/2771] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:39.409536 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.409816 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.410465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.431559 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:39.432803 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:39.441922 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1380/2772] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:39.446424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.464134 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2d0a6-5b9d-4645-a29f-573468226ffc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.470434 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.471054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.471365 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.471633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.472779 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:39.473080 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.474954 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.487517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1393/2773] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:39.491945 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.501962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5ca10-705c-4493-8f03-abe2477c0538 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.506759 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.507466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.507805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.508131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.508837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.510835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.549879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1381/2774] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:39 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:39.553890 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.563871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbd7b-aed4-41cd-8988-e47b48a48442 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.621878 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.622492 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.622767 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.623037 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.623712 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.625615 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.647663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1394/2775] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:39 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:39.652235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.663019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab59d3-1f5a-4c54-83b0-4cace1a98789 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.669699 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.670305 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.670581 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.670848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.671571 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.673197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.683320 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1382/2776] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:23:39.687899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.698176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16dc23-eaf9-48bd-8be4-96312b77395f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.702819 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.703540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.703818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.704093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.704737 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.706354 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6488e6-d9d5-4fa8-8e22-b30be08c1833 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.716923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1395/2777] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:39.721160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.731813 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f17f28-7a10-4f42-aa79-eb61dd24596c admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:39.736665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:39.737327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.737750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.738037 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] PATH_INFO: `/v3/projects/053e4b17b75b45f882ae588872487cac/users/1bf398c1a85946a2a8955dc415be7b4b/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.755472 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053e4b17b75b45f882ae588872487cac, user_id=1bf398c1a85946a2a8955dc415be7b4b, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:39.759126 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:39.775570 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1383/2778] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:39 2022] PUT /identity/v3/projects/053e4b17b75b45f882ae588872487cac/users/1bf398c1a85946a2a8955dc415be7b4b/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:39.786280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:39.786565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:39.786833 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:39.829438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] MFA Rules not processed for user `1bf398c1a85946a2a8955dc415be7b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:39.830871 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:39.899243 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1396/2779] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:39.912019 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:39.913775 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:39.994197 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece2067-8e2c-46e9-a2b6-4de777ef4b46 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:40.000147 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:40.000778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:40.001057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:40.001313 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:40.009496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:40.011045 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98dc71-17a2-4a09-9896-cb7d9133b1f4 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:40.021970 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1384/2780] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:40.237576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:40.257805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:40.301942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c2e1-e5cc-4821-8229-d28c73f0ec1e None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:40.307038 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:40.307713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:40.307986 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:40.308252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] PATH_INFO: `/v3/users/1bf398c1a85946a2a8955dc415be7b4b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:40.309425 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf398c1a85946a2a8955dc415be7b4b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:40.311440 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:40.367578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf398c1a85946a2a8955dc415be7b4b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.368256 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf398c1a85946a2a8955dc415be7b4b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.368886 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf398c1a85946a2a8955dc415be7b4b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.375880 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf398c1a85946a2a8955dc415be7b4b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.383139 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf398c1a85946a2a8955dc415be7b4b'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.401286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1397/2781] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:40 2022] DELETE /identity/v3/users/1bf398c1a85946a2a8955dc415be7b4b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:40.405940 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550818be-a867-41b8-b914-28ce00357851 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:40.406450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550818be-a867-41b8-b914-28ce00357851 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:40.406450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550818be-a867-41b8-b914-28ce00357851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:40.428095 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-550818be-a867-41b8-b914-28ce00357851 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:40.429344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-550818be-a867-41b8-b914-28ce00357851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:40.481099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:40.496540 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1385/2782] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:40.506765 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:40.508307 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:40.569276 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d87f6c-bca9-455d-9669-fd45d1a7c910 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:40.573178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:40.573783 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:40.574056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:40.574324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:40.584115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:40.585544 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd869f0-2b52-4f90-9b14-41413d69dd0c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:40.595580 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1398/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:40.892799 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550818be-a867-41b8-b914-28ce00357851 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:40.894409 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-550818be-a867-41b8-b914-28ce00357851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:40.907263 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550818be-a867-41b8-b914-28ce00357851 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:40.912433 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:40.913106 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:40.913376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:40.913638 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] PATH_INFO: `/v3/projects/053e4b17b75b45f882ae588872487cac` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:40.914809 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053e4b17b75b45f882ae588872487cac)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:40.916765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:40.966596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053e4b17b75b45f882ae588872487cac', 'request_id': 'req-70be9737-cff3-49b9-833b-48fbc43e84d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.972900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053e4b17b75b45f882ae588872487cac', 'request_id': 'req-70be9737-cff3-49b9-833b-48fbc43e84d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.978516 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053e4b17b75b45f882ae588872487cac', 'request_id': 'req-70be9737-cff3-49b9-833b-48fbc43e84d0'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.993388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] The token cache is being invalidate because project 053e4b17b75b45f882ae588872487cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:40.993676 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.994307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-70be9737-cff3-49b9-833b-48fbc43e84d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:40.995839 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1386/2784] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:40 2022] DELETE /identity/v3/projects/053e4b17b75b45f882ae588872487cac => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:41.001075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.001566 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.001676 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.023534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:41.025244 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:41.060723 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:41.092664 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1399/2785] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:41.102107 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.102405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.102663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.125053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:41.126298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:41.138194 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1387/2786] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:41.144027 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.154529 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308983f-ae89-4c84-aeb2-f3864286ba22 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.160246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.160857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.161152 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.161433 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.162140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:41.162465 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.164146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.178084 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1400/2787] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:41.182804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.194492 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f7cd-71ed-4026-a6e5-65f59883ffc9 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.200453 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.201077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.201352 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.201621 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.202254 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.204386 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.237410 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1388/2788] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:41.238521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.248899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9a1c-717e-454d-8737-c0df856bab9d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.308325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.308940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.309219 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.309489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.310201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.312183 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.336079 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1401/2789] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:23:41.340299 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.350793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bfab5-289b-4304-9efc-639072530bf5 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.355573 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.356205 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.356978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.356978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.357350 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.359139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.371375 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1389/2790] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:41.375460 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.386104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909da4-c885-4365-8dca-6a271a70ff1a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.391786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.392398 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.392673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.392941 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.393582 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.395532 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419cbb6-9d57-4cb9-8cb1-b3873e2d23e1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.407334 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1402/2791] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:41.412134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.422284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db7f40-dcf6-496d-983e-86e31f9103d0 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.427225 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.427897 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.428168 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.428435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] PATH_INFO: `/v3/projects/d74dcd82b3464eeaa1836fd627da2653/users/860dbf8b519342b5adc0b70f8e4f83d2/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.443596 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74dcd82b3464eeaa1836fd627da2653, user_id=860dbf8b519342b5adc0b70f8e4f83d2, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.446307 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.462040 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1390/2792] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:41 2022] PUT /identity/v3/projects/d74dcd82b3464eeaa1836fd627da2653/users/860dbf8b519342b5adc0b70f8e4f83d2/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:41.472800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.473222 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.473519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.502405 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] MFA Rules not processed for user `860dbf8b519342b5adc0b70f8e4f83d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:41.503696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:41.570301 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1403/2793] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:41.574752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.644000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7754b-bd61-4af3-baa3-886a0c0e03c3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.649271 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.649876 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.650150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.650413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.651012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.652964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.675055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:41.682980 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1391/2794] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:41.687238 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.698453 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f12dca-474f-4bb8-92cd-abce0e62eea2 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.732246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:41.759436 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.760054 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.760348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.760604 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.761254 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.763161 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.788179 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1404/2795] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:41 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:41.792234 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.802704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6933-244e-4f96-9924-dbb0100127a1 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.807387 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.808143 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.808487 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.808822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.809534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.811223 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.822500 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1392/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:41.826764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.836865 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a7fa8-e825-4aaa-9f7e-70cf38b6477b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.841721 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.842380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.842656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.842924 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] PATH_INFO: `/v3/projects/c811377d44d74abba385c06ba3467ac2/users/7eb48c9ff7a840949b9e7e3acdad33ed/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.860111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c811377d44d74abba385c06ba3467ac2, user_id=7eb48c9ff7a840949b9e7e3acdad33ed, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.862799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.881828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1405/2797] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:41 2022] PUT /identity/v3/projects/c811377d44d74abba385c06ba3467ac2/users/7eb48c9ff7a840949b9e7e3acdad33ed/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:23:41.887639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.899357 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830339d8-674d-45d0-afc7-7cc73fa08ed4 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.956990 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.957595 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.957872 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.958139 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.958776 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.960415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae401da-2ea3-483a-b64c-6d27af1db7b1 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:41.970407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1393/2798] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:41.974768 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:41.985102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8831be-de17-49b6-bb4b-ae6fdc1b7b4b admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:41.989995 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:41.990635 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:41.990911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:41.991196 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] PATH_INFO: `/v3/projects/c811377d44d74abba385c06ba3467ac2/users/7eb48c9ff7a840949b9e7e3acdad33ed/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:41.993208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c811377d44d74abba385c06ba3467ac2, user_id=7eb48c9ff7a840949b9e7e3acdad33ed, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:41.995855 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:42.006149 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1406/2799] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:41 2022] PUT /identity/v3/projects/c811377d44d74abba385c06ba3467ac2/users/7eb48c9ff7a840949b9e7e3acdad33ed/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:42.017647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:42.017936 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:42.018214 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:42.047514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] MFA Rules not processed for user `7eb48c9ff7a840949b9e7e3acdad33ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:42.048713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:42.119973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1394/2800] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:42.132270 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:42.134272 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:42.204530 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cecc1-b1af-4a11-8fdb-76b7235a7e7a admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:42.208718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:42.209369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:42.209644 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:42.209911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:42.219596 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:42.221010 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968369e-0bb1-4338-9711-8835674889bf service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:42.230283 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1407/2801] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:42.692962 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:42.759565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4c940-3e37-4823-b4be-779bec68aede None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:42.764892 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:42.765525 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:42.765805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:42.766068 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] PATH_INFO: `/v3/users/860dbf8b519342b5adc0b70f8e4f83d2` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:42.767298 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=860dbf8b519342b5adc0b70f8e4f83d2)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:42.769435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:42.781505 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:42.819514 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860dbf8b519342b5adc0b70f8e4f83d2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:42.828367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860dbf8b519342b5adc0b70f8e4f83d2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:42.835349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860dbf8b519342b5adc0b70f8e4f83d2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:42.836026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860dbf8b519342b5adc0b70f8e4f83d2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:42.847748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860dbf8b519342b5adc0b70f8e4f83d2'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:42.853808 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1395/2802] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:42 2022] DELETE /identity/v3/users/860dbf8b519342b5adc0b70f8e4f83d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:42.858494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:42.858817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:42.859094 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:42.878392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:42.879623 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:42.938130 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1408/2803] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:42.948006 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:42.949633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:43.010119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261742-d7a4-410e-8607-ca78dad452bf admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:43.014153 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:43.014752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:43.015026 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:43.015326 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:43.024996 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:43.026437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:43.035964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1396/2804] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:43.321752 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:43.323424 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:43.336372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0de1fd-1940-4c2c-95a2-944b38ce9db6 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:43.342060 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:43.342814 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:43.343141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:43.343451 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] PATH_INFO: `/v3/projects/d74dcd82b3464eeaa1836fd627da2653` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:43.344775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74dcd82b3464eeaa1836fd627da2653)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:43.346631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:43.378369 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:43.396430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74dcd82b3464eeaa1836fd627da2653', 'request_id': 'req-243cad4a-dd54-4c06-915e-5229dc4e79a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.402701 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74dcd82b3464eeaa1836fd627da2653', 'request_id': 'req-243cad4a-dd54-4c06-915e-5229dc4e79a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.411659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74dcd82b3464eeaa1836fd627da2653', 'request_id': 'req-243cad4a-dd54-4c06-915e-5229dc4e79a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.421894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] The token cache is being invalidate because project d74dcd82b3464eeaa1836fd627da2653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:43.422171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.422781 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.424370 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1409/2805] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:43 2022] DELETE /identity/v3/projects/d74dcd82b3464eeaa1836fd627da2653 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:43.428341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:43.437804 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcbd7b-c4c4-4697-9d80-e6f77d186778 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:43.497030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:43.497597 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:43.497877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:43.498150 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] PATH_INFO: `/v3/users/7eb48c9ff7a840949b9e7e3acdad33ed` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:43.499362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb48c9ff7a840949b9e7e3acdad33ed)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:43.501334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:43.538698 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:43.552404 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb48c9ff7a840949b9e7e3acdad33ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.560821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb48c9ff7a840949b9e7e3acdad33ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.568230 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb48c9ff7a840949b9e7e3acdad33ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.568833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb48c9ff7a840949b9e7e3acdad33ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.580353 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-975f87fb-68be-4419-93bb-721e0cd6ceeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb48c9ff7a840949b9e7e3acdad33ed'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:43.586091 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1397/2806] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:43 2022] DELETE /identity/v3/users/7eb48c9ff7a840949b9e7e3acdad33ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:43.866231 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:43.867755 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:43.881808 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cad4a-dd54-4c06-915e-5229dc4e79a4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:43.940769 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:43.941404 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:43.941679 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:43.941952 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] PATH_INFO: `/v3/projects/c811377d44d74abba385c06ba3467ac2` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:43.943560 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c811377d44d74abba385c06ba3467ac2)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:43.945912 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:43.997555 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c811377d44d74abba385c06ba3467ac2', 'request_id': 'req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:44.003911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c811377d44d74abba385c06ba3467ac2', 'request_id': 'req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:44.013926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c811377d44d74abba385c06ba3467ac2', 'request_id': 'req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:44.025386 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] The token cache is being invalidate because project c811377d44d74abba385c06ba3467ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:44.025668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:44.026303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-d2636fd1-d8fd-42e8-9a27-94aef26ff6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:44.027837 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1410/2807] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:43 2022] DELETE /identity/v3/projects/c811377d44d74abba385c06ba3467ac2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:44.032912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.033443 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.033552 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.053815 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:44.055046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:44.119946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1398/2808] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:44.128294 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.128636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.128905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.150961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:44.152202 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:44.163160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1411/2809] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:44.167753 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.178080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab459a-fba9-4de9-a844-f26c6b2b5861 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.183755 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.184349 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.184626 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.184890 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.185530 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:44.185891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.187618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.199199 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1399/2810] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:44.203805 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.213355 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59479af3-4184-4177-83f2-402ceccf71a8 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.219075 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.219705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.220098 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.220372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.220998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.222893 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.253493 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1412/2811] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:44.257783 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.268732 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4e81f-1c6b-463a-be40-ad96ecddb53a admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.328430 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.328953 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.329232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.329498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.330115 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.332085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.354323 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1400/2812] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:44.360081 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.371119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bdc9e-0f24-49d1-9251-55e723bba2b6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.377445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.378048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.378324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.378589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.379259 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.380857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.392185 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1413/2813] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:23:44.396910 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.407515 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a745a8-3e38-48ca-8af5-607bf6d21183 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.412510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.413114 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.413397 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.413674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.414327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.416007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62ffb-ed80-4c67-af32-839335dd6464 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.427017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1401/2814] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:44.431336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.437896 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:44.441888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62644838-fc9e-4eda-a0a9-a17b125043e6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.448640 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.449327 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.450040 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.450417 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] PATH_INFO: `/v3/projects/5b1824e4431743a093ff963eb98bcd6d/users/a5d52fb537b5447395e157b58d564e2b/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.465470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1824e4431743a093ff963eb98bcd6d, user_id=a5d52fb537b5447395e157b58d564e2b, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.468227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.484015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1414/2815] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:44 2022] PUT /identity/v3/projects/5b1824e4431743a093ff963eb98bcd6d/users/a5d52fb537b5447395e157b58d564e2b/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:44.494496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.494778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.495048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.523276 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] MFA Rules not processed for user `a5d52fb537b5447395e157b58d564e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:44.524451 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:44.528503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:44.592828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1402/2816] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:44.599339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.668069 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75fda6-0bda-4009-b5ba-74afca265c54 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.673636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.674232 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.674513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.674772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.675428 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.677330 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.707214 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1415/2817] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:44.711762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.728000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a002e-f88e-49d3-b46a-ed0885b54706 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.803875 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.804494 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.804773 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.805043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.805665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.807654 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.830105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1403/2818] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:44 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:23:44.834271 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.844826 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e7c5-f44f-474d-8aab-302d1fd01ac8 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.849731 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.850323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.850628 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.850905 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.851586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.853178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.864599 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1416/2819] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:44.868903 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.879557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb31e23-fca3-429c-9d77-ee3013a013bd admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.884784 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.885438 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.885723 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.886016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] PATH_INFO: `/v3/projects/a60c6621783b45038708ecb1213b114b/users/152033239dfd48908adbeed38e5ebf41/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.901367 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60c6621783b45038708ecb1213b114b, user_id=152033239dfd48908adbeed38e5ebf41, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.904232 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:44.919075 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1404/2820] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:44 2022] PUT /identity/v3/projects/a60c6621783b45038708ecb1213b114b/users/152033239dfd48908adbeed38e5ebf41/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:44.923100 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:44.933123 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aea4d-a5ee-4755-9d3e-0088fb0f68a6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:44.992611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:44.993213 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:44.993488 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:44.993758 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:44.994406 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:44.996018 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cc2e0-14b2-4454-9593-06b42430ed4a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:45.006108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1417/2821] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:45.011895 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:45.023444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b2ab-0937-4b13-b350-ad6dc704f638 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:45.029059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:45.029715 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:45.029989 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:45.030262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] PATH_INFO: `/v3/projects/a60c6621783b45038708ecb1213b114b/users/152033239dfd48908adbeed38e5ebf41/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:45.032459 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60c6621783b45038708ecb1213b114b, user_id=152033239dfd48908adbeed38e5ebf41, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:45.035134 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:45.046634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1405/2822] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:45 2022] PUT /identity/v3/projects/a60c6621783b45038708ecb1213b114b/users/152033239dfd48908adbeed38e5ebf41/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:45.064073 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:45.064410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:45.064780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:45.097543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] MFA Rules not processed for user `152033239dfd48908adbeed38e5ebf41`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:45.098683 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:45.138998 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:45.168849 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1418/2823] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:45.181204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:45.184284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:45.252196 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a5eb9-fac6-449d-9647-fa88faf6127f admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:45.256582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:45.257219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:45.257498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:45.257769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:45.267666 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:45.269119 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:45.274518 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:45.279850 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1406/2824] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:45.360873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:45.370586 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc959b-5e74-4228-b511-52e357709a5b None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:45.374268 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:45.374923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:45.375258 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:45.375537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:45.433427 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:45.434920 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe829c7-c787-4081-a598-20209ed84de7 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:45.444657 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1419/2825] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:52.629372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:52.692541 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d679c02-17af-4f1f-9bf5-9293889a1d2e service cinder] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:52.698233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:52.698796 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:52.699071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:52.699380 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] PATH_INFO: `/v3/users/a5d52fb537b5447395e157b58d564e2b` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:52.700558 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d52fb537b5447395e157b58d564e2b)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:52.702481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:52.750817 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d52fb537b5447395e157b58d564e2b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:52.761925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d52fb537b5447395e157b58d564e2b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:52.769585 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d52fb537b5447395e157b58d564e2b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:52.770844 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d52fb537b5447395e157b58d564e2b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:52.787478 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d52fb537b5447395e157b58d564e2b'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:52.796639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1407/2826] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:52 2022] DELETE /identity/v3/users/a5d52fb537b5447395e157b58d564e2b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:52.804677 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:52.805468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:52.805468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:52.826274 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:52.827614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:52.888505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1420/2827] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:52.899456 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:52.901047 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:52.962101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb45f-2f46-44ab-a0fb-46e7eed3a87b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:52.966207 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:52.966818 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:52.967096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:52.967389 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:52.977023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:52.978498 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:52.987954 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1408/2828] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:23:53.271121 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:53.272797 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:53.285856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5843da-1d59-4131-a03f-e77bd8009e6d None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:53.291655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:53.292309 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:53.292565 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:53.292835 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] PATH_INFO: `/v3/projects/5b1824e4431743a093ff963eb98bcd6d` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:53.294061 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1824e4431743a093ff963eb98bcd6d)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:53.296172 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:53.348396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1824e4431743a093ff963eb98bcd6d', 'request_id': 'req-c2aab773-014c-43c0-8116-607dcede069d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.354698 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1824e4431743a093ff963eb98bcd6d', 'request_id': 'req-c2aab773-014c-43c0-8116-607dcede069d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.363899 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1824e4431743a093ff963eb98bcd6d', 'request_id': 'req-c2aab773-014c-43c0-8116-607dcede069d'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.372041 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:53.379464 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] The token cache is being invalidate because project 5b1824e4431743a093ff963eb98bcd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:53.379964 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.380786 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.382357 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1421/2829] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:53 2022] DELETE /identity/v3/projects/5b1824e4431743a093ff963eb98bcd6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:53.386481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:53.396840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46b495-5470-4fd3-9e59-acf2f52f283b service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:53.415543 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:53.458923 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:53.459565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:53.459856 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:53.460113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] PATH_INFO: `/v3/users/152033239dfd48908adbeed38e5ebf41` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:53.461282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=152033239dfd48908adbeed38e5ebf41)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:53.463209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:53.514826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152033239dfd48908adbeed38e5ebf41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.523481 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152033239dfd48908adbeed38e5ebf41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.530633 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152033239dfd48908adbeed38e5ebf41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.531445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152033239dfd48908adbeed38e5ebf41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.543084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-63df7e8e-495c-4917-9919-1753e5d6f5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152033239dfd48908adbeed38e5ebf41'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.549310 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1409/2830] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:23:53 2022] DELETE /identity/v3/users/152033239dfd48908adbeed38e5ebf41 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:53.836006 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:53.837697 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:53.852065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab773-014c-43c0-8116-607dcede069d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:53.913799 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:53.914981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:53.915474 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:53.915973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] PATH_INFO: `/v3/projects/a60c6621783b45038708ecb1213b114b` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:53.917656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60c6621783b45038708ecb1213b114b)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:53.921324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:53.971028 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60c6621783b45038708ecb1213b114b', 'request_id': 'req-2702eb53-f06d-40b0-bf34-4cee87b9c643'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.977166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60c6621783b45038708ecb1213b114b', 'request_id': 'req-2702eb53-f06d-40b0-bf34-4cee87b9c643'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.986246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60c6621783b45038708ecb1213b114b', 'request_id': 'req-2702eb53-f06d-40b0-bf34-4cee87b9c643'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.996705 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] The token cache is being invalidate because project a60c6621783b45038708ecb1213b114b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:23:53.997016 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.997689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-2702eb53-f06d-40b0-bf34-4cee87b9c643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:23:53.999199 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1422/2831] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:23:53 2022] DELETE /identity/v3/projects/a60c6621783b45038708ecb1213b114b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:54.004769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.005331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.005331 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.029018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:54.030151 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:54.092977 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1410/2832] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:54.101136 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.101420 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.101689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.121505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:54.122718 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:54.131450 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1423/2833] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:23:54.135770 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.146085 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a482e5-952b-40f6-87fb-467fe14a0377 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.151619 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.152221 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.152513 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.152766 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.153405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:23:54.153704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.155336 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.167857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1411/2834] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:23:54.172350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.182227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06087f0a-a560-46aa-91a6-cad61655ecfc None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.189201 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.189806 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.190082 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.190350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.190981 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.192962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.223509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1424/2835] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:23:54 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:54.229146 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.239318 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f1fd-8e6f-44a2-9c49-33cfb4aa9e96 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.265023 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:54.301582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.302123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.302403 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.302674 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.303312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.305277 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.326523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1412/2836] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:23:54 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:23:54.330791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.341483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25b8f-2b62-4c71-9a37-1c9a687f500d admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.346377 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.346967 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.347277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.347548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.348181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.349815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.360611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1425/2837] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:23:54.364840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.375589 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5585-4ee7-4c61-be21-bb5228086382 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.381921 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.382524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.382810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.383077 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.383758 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.385377 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457fab-7619-4e09-b7c0-80b52cf5de77 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.397157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1413/2838] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:23:54.401501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.412323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95a26-d8b2-49ba-8b54-24ab01d50da7 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.418051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.418689 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.418968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.419260 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] PATH_INFO: `/v3/projects/fc50c1a513e448bc8b2af5cf086ad345/users/6c2f981d38da4395b878b4cd463848d6/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.435509 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc50c1a513e448bc8b2af5cf086ad345, user_id=6c2f981d38da4395b878b4cd463848d6, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.438282 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.453513 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1426/2839] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:23:54 2022] PUT /identity/v3/projects/fc50c1a513e448bc8b2af5cf086ad345/users/6c2f981d38da4395b878b4cd463848d6/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:23:54.464366 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.464647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.464916 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.493864 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] MFA Rules not processed for user `6c2f981d38da4395b878b4cd463848d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:23:54.495069 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:54.565826 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1414/2840] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:23:54.577074 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:23:54.579015 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:23:54.607668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:23:54.661160 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b1bd5-f215-412d-a7c4-7152156920c4 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:23:54.665113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:23:54.665713 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:23:54.665985 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:23:54.666264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:23:54.675277 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:23:54.676745 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b87c8-9a62-4440-9761-edf104efb43a service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:23:54.686176 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1427/2841] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:04.562942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:04.681961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=24 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:14.544466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:14.614629 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09cf3c-693b-4f65-b40b-132bcccf459b None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:14.619716 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:14.620354 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:14.620747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:14.621029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] PATH_INFO: `/v3/users/6c2f981d38da4395b878b4cd463848d6` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:14.622174 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2f981d38da4395b878b4cd463848d6)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:14.624172 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:14.680645 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2f981d38da4395b878b4cd463848d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:14.689656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2f981d38da4395b878b4cd463848d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:14.696835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2f981d38da4395b878b4cd463848d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:14.697565 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2f981d38da4395b878b4cd463848d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:14.710896 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2f981d38da4395b878b4cd463848d6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:14.717322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1415/2842] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:24:14 2022] DELETE /identity/v3/users/6c2f981d38da4395b878b4cd463848d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:24:14.721990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:14.722456 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:14.722576 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:14.742668 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:14.743914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:14.805791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1428/2843] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:14.815712 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:14.817195 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:14.875551 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077790-8f1f-4eca-a6df-70ef6debae34 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:14.879555 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:14.880155 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:14.880431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:14.880696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:14.890042 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:14.891497 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd875d-7450-4b2a-820f-ac3466c3f747 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:14.901484 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1416/2844] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:15.184286 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.185762 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:15.200062 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c97b4-0773-4284-b438-db4f2d9df482 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.207131 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.207791 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.208093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.208323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] PATH_INFO: `/v3/projects/fc50c1a513e448bc8b2af5cf086ad345` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.209501 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc50c1a513e448bc8b2af5cf086ad345)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.211394 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.259392 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc50c1a513e448bc8b2af5cf086ad345', 'request_id': 'req-52c007ac-4073-457e-a336-0cb5d771f774'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:15.265743 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc50c1a513e448bc8b2af5cf086ad345', 'request_id': 'req-52c007ac-4073-457e-a336-0cb5d771f774'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:15.275039 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc50c1a513e448bc8b2af5cf086ad345', 'request_id': 'req-52c007ac-4073-457e-a336-0cb5d771f774'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:15.286208 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] The token cache is being invalidate because project fc50c1a513e448bc8b2af5cf086ad345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:24:15.286496 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:15.287252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-52c007ac-4073-457e-a336-0cb5d771f774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:15.288961 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1429/2845] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:24:15 2022] DELETE /identity/v3/projects/fc50c1a513e448bc8b2af5cf086ad345 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:24:15.293946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.294219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.294488 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.315312 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:15.316466 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:15.333791 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:15.376942 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1417/2846] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:15.385724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.386036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.386381 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.412001 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:15.413209 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:15.421794 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1430/2847] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:15.426235 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.436848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73049e-c8d1-43fd-84b6-da6be1e4b825 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.442198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.442790 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.443067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.443372 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.444018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:24:15.444316 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.445946 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.457969 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1418/2848] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:24:15.462351 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.471693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10322ea9-65ef-4580-8b4c-bebc60d1243f None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.477251 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.477873 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.478148 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.478410 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.479057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.481167 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.516396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1431/2849] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:24:15.521814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.532901 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcea93-6e0d-4776-aa5e-77be9ac26989 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.595833 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.596503 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.596620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.596866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.597476 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.599462 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.623832 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1419/2850] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:24:15 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:24:15.627994 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.638407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acae1-5b84-4a18-b75e-2f0fc73b2db1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.643437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.644053 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.644379 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.644652 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.645608 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.647206 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.657569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1432/2851] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:24:15.661444 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.672043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0bd2-52ab-4b06-bd5d-a8a5be38b37b admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.676882 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.677468 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.677743 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.678007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.678665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.680376 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53a794-7f95-4c32-811d-51d84bae88e5 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.691099 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1420/2852] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:24:15.695241 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.705517 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81263df8-9c03-4342-99c7-c03df1ed9605 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.710508 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.711147 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.711458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.711732 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] PATH_INFO: `/v3/projects/0c7db1e9ad93496da8bae34b4cfec3b5/users/de2d1b1ca5554355a69cb5140ebba5d4/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.726448 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7db1e9ad93496da8bae34b4cfec3b5, user_id=de2d1b1ca5554355a69cb5140ebba5d4, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.729216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.744407 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1433/2853] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:24:15 2022] PUT /identity/v3/projects/0c7db1e9ad93496da8bae34b4cfec3b5/users/de2d1b1ca5554355a69cb5140ebba5d4/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:24:15.755096 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.755425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.755691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.783611 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] MFA Rules not processed for user `de2d1b1ca5554355a69cb5140ebba5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:15.784812 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:15.851542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1421/2854] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:15.862820 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:15.864894 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:15.887858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:15.924627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d60d0-aa2c-4e18-914a-8e62ed930d76 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:15.928754 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:15.929356 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:15.929611 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:15.929904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:15.939255 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:15.940704 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e7cfa-606a-4af0-a84d-3a6e0b5fbd20 service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:15.949904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1434/2855] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:21.380830 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:21.402074 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:21.448761 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b9945-93df-4808-9d25-4293783fa6a1 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:21.454680 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:21.455358 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:21.455634 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:21.455899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] PATH_INFO: `/v3/users/de2d1b1ca5554355a69cb5140ebba5d4` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:21.457140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2d1b1ca5554355a69cb5140ebba5d4)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:21.459110 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:21.510968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2d1b1ca5554355a69cb5140ebba5d4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:21.520670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2d1b1ca5554355a69cb5140ebba5d4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:21.528242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2d1b1ca5554355a69cb5140ebba5d4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:21.528974 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2d1b1ca5554355a69cb5140ebba5d4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:21.541522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2d1b1ca5554355a69cb5140ebba5d4'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:21.547524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1422/2856] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:24:21 2022] DELETE /identity/v3/users/de2d1b1ca5554355a69cb5140ebba5d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:24:21.552273 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:21.552802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:21.552802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:21.572358 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:21.573617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:21.635319 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1435/2857] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:21.645258 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:21.647102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:21.708035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefc23c-b67e-41a1-a824-9965341de8ab admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:21.712061 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:21.712672 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:21.712948 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:21.713219 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:21.722547 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:21.724059 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4c25b-7fc0-4cc9-b6e9-5221f08fe5db service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:21.733479 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1423/2858] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:22.006141 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.007638 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:22.020205 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b8dd8-6946-4a57-972b-982b07ee1bdd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.025169 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.025789 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.026065 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.026335 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] PATH_INFO: `/v3/projects/0c7db1e9ad93496da8bae34b4cfec3b5` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.027483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7db1e9ad93496da8bae34b4cfec3b5)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.029466 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.077585 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7db1e9ad93496da8bae34b4cfec3b5', 'request_id': 'req-ab2af52d-4005-4078-b5d5-f894d38bca6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:22.083782 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7db1e9ad93496da8bae34b4cfec3b5', 'request_id': 'req-ab2af52d-4005-4078-b5d5-f894d38bca6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:22.093543 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7db1e9ad93496da8bae34b4cfec3b5', 'request_id': 'req-ab2af52d-4005-4078-b5d5-f894d38bca6f'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:22.105735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] The token cache is being invalidate because project 0c7db1e9ad93496da8bae34b4cfec3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:24:22.106017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:22.106636 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-ab2af52d-4005-4078-b5d5-f894d38bca6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:24:22.108207 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1436/2859] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:24:22 2022] DELETE /identity/v3/projects/0c7db1e9ad93496da8bae34b4cfec3b5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:24:22.113329 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.113616 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.113877 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.257274 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:22.258509 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:22.304244 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:22.332887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1424/2860] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:24:22.396735 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.397013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.397264 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.418631 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:22.419917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:22.429032 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1437/2861] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:22.434204 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.445398 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29046875-08cc-4fc2-9fda-3b442422cf08 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.451848 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.452450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.452725 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.452993 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.453632 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:24:22.453944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.455601 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.468044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1425/2862] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 13:24:22.472545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.481992 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4a6b-2dfb-46be-a53b-068cc2f23801 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.486990 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.487605 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.487875 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.488137 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.489088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.491350 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.520014 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1438/2863] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:24:22 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:24:22.524647 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.534792 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93254834-b9f0-4ee4-bc8a-a695de9d11ec admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.589944 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.590537 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.590845 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.591113 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.591752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.593665 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.617373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1426/2864] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:24:22 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:24:22.621736 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.632375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9ca0-8eea-472b-8cf2-f4856db39c21 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.637102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.637832 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.638111 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.638380 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.639023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.640659 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.651618 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1439/2865] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:24:22.655688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.666142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fc94c-ef8e-4ffd-9443-0c6d677d5aeb admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.671788 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.672385 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.672639 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.672905 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.673544 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.675157 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a141-e8b8-4e24-8a8a-870cc455d8bc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.685419 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1427/2866] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:24:22.689594 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.699658 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c785a-bcc6-4d85-86f7-bb1615cd4243 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.704563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.705203 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.705483 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.705760 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] PATH_INFO: `/v3/projects/be1310b1d1184aabbd5136c17adb2765/users/842e49d391da49f3ae053a02151a008f/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.708058 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:22.722280 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1310b1d1184aabbd5136c17adb2765, user_id=842e49d391da49f3ae053a02151a008f, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.725146 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.739614 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1440/2867] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:24:22 2022] PUT /identity/v3/projects/be1310b1d1184aabbd5136c17adb2765/users/842e49d391da49f3ae053a02151a008f/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:24:22.744857 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be88b56-9c7b-4882-95a5-3978a02b3cfd None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.745256 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be88b56-9c7b-4882-95a5-3978a02b3cfd None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.745593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be88b56-9c7b-4882-95a5-3978a02b3cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.765734 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-6be88b56-9c7b-4882-95a5-3978a02b3cfd None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:22.766979 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6be88b56-9c7b-4882-95a5-3978a02b3cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:22.827659 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1428/2868] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:22.838115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:22.840567 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:22.900619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a157-6027-440f-b3ff-406a1e0c1085 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:22.904809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:22.905413 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:22.905686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:22.905956 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:22.915177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:22.916633 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:22.925963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1441/2869] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:23.553649 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8053-20a9-442f-a584-d10c9f4539fb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:23.554198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8053-20a9-442f-a584-d10c9f4539fb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:23.554198 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c8053-20a9-442f-a584-d10c9f4539fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:23.581373 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-829c8053-20a9-442f-a584-d10c9f4539fb None None] MFA Rules not processed for user `842e49d391da49f3ae053a02151a008f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:23.582604 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-829c8053-20a9-442f-a584-d10c9f4539fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:23.618118 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:23.652283 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1429/2870] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:23.663302 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:23.664734 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:23.723484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900db9e7-b60e-4282-9e31-d104dc6d1ff6 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:23.727756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99f8096be0f41399f34257c8a1cd5ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:23.728375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:23.728648 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:23.728913 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:23.738322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:23.739817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:23.748923 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1442/2871] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:25.123663 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:25.124190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:25.124190 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:25.144148 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] MFA Rules not processed for user `842e49d391da49f3ae053a02151a008f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:25.145692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:25.153777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1430/2872] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:25.201430 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:25.202950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:25.275333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3cb-b503-4add-8b16-11752836d8ad service cinder] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:25.279445 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ed0e5eabf49d2816ab27e21e54985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:25.280045 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:25.280320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:25.280589 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:25.282322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:25.327882 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:25.356367 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:25.357809 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:25.368976 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1443/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:25.589794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:25.591707 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:25.604919 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71124c7-fa68-40bd-adcd-3931d9b6a2f4 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:25.609691 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:25.614435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:25.614435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:25.614435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:25.614435 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:25.624057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:25.625499 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:25.633968 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1431/2874] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:25.994133 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:25.995556 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:26.002390 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:26.011425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b019-8f1d-4c97-b8b4-ac269cd7c3f8 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:26.015675 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:26.016300 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:26.016572 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:26.016827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:26.018750 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:26.033425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:26.034847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:26.046098 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1432/2875] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:26.065333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038ab8b-8abe-4fff-9292-c526aa3356af service glance] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:26.070345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:26.070948 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:26.071247 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:26.071520 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:26.073228 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:26.085827 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:26.087435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:26.098237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1444/2876] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:27.856622 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:27.865939 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373995a-4a42-4d8e-ab91-b8019aa8f702 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:27.870414 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:27.871048 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:27.871362 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:27.871636 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:27.873777 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:27.883847 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:27.885296 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e02c0-9438-478a-ad2a-af7a50232dd4 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:27.893577 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1433/2877] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:28.771548 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:28.773325 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:28.791401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d444857-0612-4841-a230-b3a8aa666a55 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:28.798385 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:28.799099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:28.799473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:28.799824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:28.801711 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:28.820333 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:28.821926 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:28.834285 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1445/2878] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:37.889955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=32 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:38.828545 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=52 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:43.207752 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:43.208334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:43.208334 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:43.236361 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] MFA Rules not processed for user `842e49d391da49f3ae053a02151a008f`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:24:43.238100 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:43.249735 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1434/2879] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:24:44.025757 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:44.037310 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b48bff-0ba5-42c6-8709-453eff66e16b service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:44.041962 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:44.042569 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:44.042844 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:44.043113 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:44.045252 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:44.056104 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:44.057578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a3f6-e4ce-4979-84db-1ee83022dc57 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:44.066177 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1446/2880] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:53.228021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=3 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:24:53.871823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:24:53.885917 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03fcc-7755-43a1-8da1-30e1feb02abb None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:24:53.891664 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:24:53.892278 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:24:53.892562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:24:53.892834 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:24:53.894745 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:24:53.907710 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:24:53.909343 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:24:53.919943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1435/2881] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:24:54.062373 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=6 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:25:02.109824 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670ac1-df91-4be2-8e6e-334bd2da9572 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:02.110439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670ac1-df91-4be2-8e6e-334bd2da9572 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:02.110439 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670ac1-df91-4be2-8e6e-334bd2da9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:02.165159 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-9f670ac1-df91-4be2-8e6e-334bd2da9572 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:25:02.166360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-9f670ac1-df91-4be2-8e6e-334bd2da9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:25:02.234729 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1447/2882] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:25:02.276252 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:25:02.277835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:25:02.376262 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc0eee-0fd4-4115-a4ec-fed68adf774d service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:25:02.382768 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:25:02.383418 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:02.383695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:02.383964 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:02.393057 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:25:02.394692 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:25:02.403873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1436/2883] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:25:12.231479 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=40 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:25:12.400268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=47 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:25:17.748801 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:17.749345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:17.749345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:17.768914 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:25:17.770117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:25:17.778979 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1448/2884] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:25:17.792486 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:25:17.803731 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71ab5-95fe-4a59-bae6-1057346c34ef service swift] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:25:17.810186 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:25:17.810778 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:17.811051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:17.811344 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:17.820102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:25:17.821683 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:25:17.830028 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1437/2885] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 13:25:19.706293 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:25:19.707950 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:25:19.725085 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9722d0-c6d3-4836-85cd-fad16e026e6a None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:25:19.731088 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:25:19.731663 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:19.731943 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:19.732246 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:19.734323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:25:19.747408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:25:19.749048 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:25:19.760918 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1449/2886] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:25:19.761103 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:25:19.772388 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed401-e29a-4d99-9812-5f5703ffae01 service swift] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:25:19.777067 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:25:19.777767 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:19.778101 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:19.778437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] PATH_INFO: `/v3/users/842e49d391da49f3ae053a02151a008f` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:19.779747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842e49d391da49f3ae053a02151a008f)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:25:19.782046 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:25:19.831043 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842e49d391da49f3ae053a02151a008f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:19.839123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842e49d391da49f3ae053a02151a008f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:19.845997 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842e49d391da49f3ae053a02151a008f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:19.846615 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842e49d391da49f3ae053a02151a008f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:19.858050 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842e49d391da49f3ae053a02151a008f'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:19.863965 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1438/2887] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:25:19 2022] DELETE /identity/v3/users/842e49d391da49f3ae053a02151a008f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:25:20.037796 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:25:20.049289 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59938fee-e7d7-439d-9db6-75291e13e5ce service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:25:20.106822 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:25:20.107473 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:25:20.107747 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:25:20.108013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] PATH_INFO: `/v3/projects/be1310b1d1184aabbd5136c17adb2765` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:25:20.109117 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1310b1d1184aabbd5136c17adb2765)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:25:20.111017 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:25:20.158359 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1310b1d1184aabbd5136c17adb2765', 'request_id': 'req-81f14a7b-7a42-4909-a414-3d48d96be398'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:20.164378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1310b1d1184aabbd5136c17adb2765', 'request_id': 'req-81f14a7b-7a42-4909-a414-3d48d96be398'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:20.177777 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1310b1d1184aabbd5136c17adb2765', 'request_id': 'req-81f14a7b-7a42-4909-a414-3d48d96be398'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:20.188170 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] The token cache is being invalidate because project be1310b1d1184aabbd5136c17adb2765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:25:20.188454 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:20.189070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-81f14a7b-7a42-4909-a414-3d48d96be398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:25:20.190563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1450/2888] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:25:20 2022] DELETE /identity/v3/projects/be1310b1d1184aabbd5136c17adb2765 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:25:29.860651 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:25:30.185215 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:04.598021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:04.600233 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:04.696333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4382659-11ce-4227-985b-1cd0ad94e0b3 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:04.773454 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:04.774523 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:04.774805 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:04.775080 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:04.778765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:04.792978 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:04.794823 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:04.808831 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1439/2889] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:26:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:26:10.823348 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:10.823959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:10.823959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:10.843780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] MFA Rules not processed for user `f4977f2d1c1c46b7995f02caeb81cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:10.845009 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:10.907372 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1451/2890] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:10.929051 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:10.930592 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:11.006840 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414f6e-79c1-4213-9745-83fffbe506f6 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:11.013105 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79dc27d463f446a3a8da3aff55b6603e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:11.013717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:11.013991 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:11.014253 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:11.023012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:11.024887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:11.032835 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1440/2891] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 13:26:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 13:26:17.536854 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:17.538437 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:17.606233 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39a2f-9476-45af-8271-3eceaf98cc33 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:17.611534 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:17.612168 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:17.612441 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:17.612708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] PATH_INFO: `/v3/users/775e3255677849c3a3b2122b936b4d7e` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:17.613911 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775e3255677849c3a3b2122b936b4d7e)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:17.615857 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:17.666591 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775e3255677849c3a3b2122b936b4d7e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:17.667162 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775e3255677849c3a3b2122b936b4d7e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:17.667821 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775e3255677849c3a3b2122b936b4d7e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:17.675933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775e3255677849c3a3b2122b936b4d7e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:17.682869 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775e3255677849c3a3b2122b936b4d7e'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:17.701602 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1452/2892] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:26:17 2022] DELETE /identity/v3/users/775e3255677849c3a3b2122b936b4d7e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:26:17.889242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:17.901711 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831a414-4a29-4755-88eb-68b47da731de service swift] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:17.912542 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=100 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:17.963724 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:17.964348 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:17.964623 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:17.964888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] PATH_INFO: `/v3/projects/6ad0d20285794aef8df806d66baf9931` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:17.966053 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad0d20285794aef8df806d66baf9931)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:17.968120 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.014918 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad0d20285794aef8df806d66baf9931', 'request_id': 'req-75823785-eeb4-4f07-bd3d-d27220e69625'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.024369 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad0d20285794aef8df806d66baf9931', 'request_id': 'req-75823785-eeb4-4f07-bd3d-d27220e69625'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.033281 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad0d20285794aef8df806d66baf9931', 'request_id': 'req-75823785-eeb4-4f07-bd3d-d27220e69625'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.049275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] The token cache is being invalidate because project 6ad0d20285794aef8df806d66baf9931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:26:18.049556 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.050179 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.051705 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1441/2893] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:26:17 2022] DELETE /identity/v3/projects/6ad0d20285794aef8df806d66baf9931 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:26:18.056004 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.057656 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:18.071722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96027-47fd-44ed-9353-43b263555d10 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.092505 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:18.130817 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.131468 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.131746 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.132013 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] PATH_INFO: `/v3/users/0408275899c44464bfb9861f818f25a4` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.133140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0408275899c44464bfb9861f818f25a4)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.135034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.191691 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0408275899c44464bfb9861f818f25a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.192336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0408275899c44464bfb9861f818f25a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.193034 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0408275899c44464bfb9861f818f25a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.201521 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0408275899c44464bfb9861f818f25a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.208742 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-30f184ba-8ca4-4274-b146-c70899e8e246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0408275899c44464bfb9861f818f25a4'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.227627 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1453/2894] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:26:18 2022] DELETE /identity/v3/users/0408275899c44464bfb9861f818f25a4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:26:18.408837 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.410394 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:18.424175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75823785-eeb4-4f07-bd3d-d27220e69625 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.483024 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.483704 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.484104 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.484384 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] PATH_INFO: `/v3/projects/e4b186a486764d17a9dfa8899da127e9` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.485524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b186a486764d17a9dfa8899da127e9)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.487522 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.531912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:18.534900 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b186a486764d17a9dfa8899da127e9', 'request_id': 'req-16163201-63cd-43c5-a5ce-752c5812ad68'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.542873 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b186a486764d17a9dfa8899da127e9', 'request_id': 'req-16163201-63cd-43c5-a5ce-752c5812ad68'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.548580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b186a486764d17a9dfa8899da127e9', 'request_id': 'req-16163201-63cd-43c5-a5ce-752c5812ad68'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.562631 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] The token cache is being invalidate because project e4b186a486764d17a9dfa8899da127e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:26:18.562913 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.563568 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-16163201-63cd-43c5-a5ce-752c5812ad68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:26:18.565089 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1442/2895] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:26:18 2022] DELETE /identity/v3/projects/e4b186a486764d17a9dfa8899da127e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:26:18.570181 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.570694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.570694 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.590457 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:18.591730 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:18.651901 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1454/2896] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:18.659947 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.660238 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.660519 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.680806 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:18.682016 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:18.690237 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1443/2897] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:18.694571 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.710284 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50275895-798e-4d33-aabb-c7b65da5e931 None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.715227 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.715836 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.716108 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.716371 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] PATH_INFO: `/v3/domains` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.717007 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 13:26:18.717303 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.718883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.733549 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1455/2898] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 13:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 13:26:18.740620 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.754820 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7d1b-631d-44f1-9486-f12ca7d51dce None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.760798 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.761402 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.761677 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.761943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.762562 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.764480 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.800123 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1444/2899] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:26:18 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:26:18.801626 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.815057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b6df-4767-4a3d-bc3c-361fac62065e admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.847904 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:18.879171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.879793 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.880070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.880336 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.880942 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.882829 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.905345 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1456/2900] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:26:18 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:26:18.909821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.920793 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfa75-2c00-4618-8c80-3cdd1a2724a2 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.926415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.927018 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.927333 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.927607 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.928257 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.929874 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.940109 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1445/2901] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:26:18.944096 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.954323 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb123-dc92-463c-af57-abd240aa16a6 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.959102 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.959802 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.960070 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.960338 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] PATH_INFO: `/v3/roles` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:18.960974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:18.962634 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23659b-c582-4dc6-8e52-99c1ca5b134a admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:18.972643 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1457/2902] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 13:26:18.976422 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:18.986695 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadfe8e-bfb5-41bb-8014-f10e920a30cc admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:18.991534 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:18.992231 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:18.992510 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:18.992822 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] PATH_INFO: `/v3/projects/21b15670aa1945ff81f66ff025959a94/users/84f03546c48e4eb3b299b9846e84092a/roles/10d6f35654da41fc8e0858935bc39a37` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:19.007748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b15670aa1945ff81f66ff025959a94, user_id=84f03546c48e4eb3b299b9846e84092a, role_id=10d6f35654da41fc8e0858935bc39a37)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:19.010405 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:19.025760 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1446/2903] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:26:18 2022] PUT /identity/v3/projects/21b15670aa1945ff81f66ff025959a94/users/84f03546c48e4eb3b299b9846e84092a/roles/10d6f35654da41fc8e0858935bc39a37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:26:19.030856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e0e11-35e0-4970-8636-f96f50217c86 None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:19.031140 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e0e11-35e0-4970-8636-f96f50217c86 None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:19.031438 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e0e11-35e0-4970-8636-f96f50217c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:19.052490 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-6b8e0e11-35e0-4970-8636-f96f50217c86 None None] MFA Rules not processed for user `91ee51bf97df4d1480625733920e3461`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:19.053722 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6b8e0e11-35e0-4970-8636-f96f50217c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:19.119866 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1458/2904] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:19.132140 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:19.133891 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:19.198035 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4600-7d68-48b3-8526-5d6f2dd20019 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:19.202988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:19.203656 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:19.203935 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:19.204209 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:19.213762 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:19.215216 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:19.225628 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1447/2905] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:26:23.178686 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.179311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.179311 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.208306 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.auth.core [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] MFA Rules not processed for user `84f03546c48e4eb3b299b9846e84092a`. Rule list: `[]` (Enabled: `True`). {{(pid=81732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:23.209775 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:23.286940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1459/2906] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:23.288102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.298185 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239a3dc-25c7-4dbd-b986-5124aec7d61a service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.303432 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.304193 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.304477 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.304751 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.305450 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.307413 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.337020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1448/2907] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 13:26:23 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 13:26:23.341023 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.351714 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a574903-a4d4-462c-9725-d408d6c49bdd None None] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.388759 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:23.410862 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.411498 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.411780 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.412047 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] PATH_INFO: `/v3/users` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.412693 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.414603 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.437174 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1460/2908] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 13:26:23 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 13:26:23.440976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.452748 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de81f8-fb48-4d42-8070-06934277ab33 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.457294 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.458017 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.458175 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.458425 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.459093 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.460827 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.472794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1449/2909] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:26:23.477051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.487673 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da75483-cd17-4d8a-a80a-0babbfed3bcd admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.492550 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.493297 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.493573 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.493850 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] PATH_INFO: `/v3/projects/a2e4676128f24bac98ae0eb1a36669ba/users/0af7f4990cb54aa48ecd6f7badceaf3a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.509883 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e4676128f24bac98ae0eb1a36669ba, user_id=0af7f4990cb54aa48ecd6f7badceaf3a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.512756 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.528939 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1461/2910] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:26:23 2022] PUT /identity/v3/projects/a2e4676128f24bac98ae0eb1a36669ba/users/0af7f4990cb54aa48ecd6f7badceaf3a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:26:23.533072 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.543524 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713719a-8e85-4f3e-80c2-1db9d6520bd7 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.580983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:23.603407 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.604038 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.604528 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.604867 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.605582 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.607374 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6c6b1-59d6-4e30-a96c-e3ea106c43a9 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.621925 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1450/2911] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 13:26:23.626320 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:23.637322 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060a4b-6ccf-4760-bbc4-fea101cfffb1 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:23.642216 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:23.642888 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] REQUEST_METHOD: `PUT` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:23.643166 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:23.643461 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] PATH_INFO: `/v3/projects/a2e4676128f24bac98ae0eb1a36669ba/users/0af7f4990cb54aa48ecd6f7badceaf3a/roles/141bba58d2d74bbfa94fb0b48af0accc` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:23.645458 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e4676128f24bac98ae0eb1a36669ba, user_id=0af7f4990cb54aa48ecd6f7badceaf3a, role_id=141bba58d2d74bbfa94fb0b48af0accc)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:23.648514 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:23.660459 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1462/2912] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 13:26:23 2022] PUT /identity/v3/projects/a2e4676128f24bac98ae0eb1a36669ba/users/0af7f4990cb54aa48ecd6f7badceaf3a/roles/141bba58d2d74bbfa94fb0b48af0accc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 13:26:27.667431 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5b57-f898-4786-a20d-4b2a8cedb6e1 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:27.667899 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5b57-f898-4786-a20d-4b2a8cedb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:27.668000 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5b57-f898-4786-a20d-4b2a8cedb6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:27.706292 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-cc3a5b57-f898-4786-a20d-4b2a8cedb6e1 None None] MFA Rules not processed for user `0af7f4990cb54aa48ecd6f7badceaf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:27.707580 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-cc3a5b57-f898-4786-a20d-4b2a8cedb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:27.791242 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1451/2913] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 13:26:27.808570 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:27.810843 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:27.922897 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66deb-efbe-4769-bc79-8d8ebe24adde admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:26:27.930042 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:26:27.930784 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:27.931056 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:27.931360 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:27.998057 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:26:27.999716 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:26:28.009771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1463/2914] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:26:29.271618 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] REQUEST_METHOD: `POST` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:26:29.272160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:26:29.272160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:26:29.292866 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.auth.core [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] MFA Rules not processed for user `84f03546c48e4eb3b299b9846e84092a`. Rule list: `[]` (Enabled: `True`). {{(pid=81733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 13:26:29.294226 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:26:29.303007 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1452/2915] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 13:26:38.005772 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:39.286718 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=48 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:26:59.966856 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:26:59.968408 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:27:00.032375 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a687e4-d434-47de-ae3b-21981820fb8e service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:27:00.038396 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:27:00.039237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:27:00.039563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:27:00.039968 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:27:00.053958 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:27:00.056178 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:27:00.066696 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1464/2916] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:26:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:27:10.062666 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=26 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:27:46.540713 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:27:46.543055 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:27:46.620275 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00bd88-6f56-4dd7-a5d9-ce1460787c75 None None] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:27:46.625828 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:27:46.626442 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:27:46.626717 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:27:46.626985 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:27:46.628924 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:27:46.640912 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:27:46.642557 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:27:46.653160 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1453/2917] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:27:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:27:56.648825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=32 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:25.812416 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:25.822119 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422f5a-4397-48da-ae12-30ee35f4c7b3 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:25.826907 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:25.827537 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:25.827815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:25.828078 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:25.830220 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:25.846051 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:25.847500 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:25.861093 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1465/2918] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:27.054044 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:27.069696 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92da46-b906-41cd-96ea-d0ddbf5ce000 service placement] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:27.076370 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:27.076988 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:27.077289 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:27.077560 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:27.079726 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:27.094269 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:27.095749 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:27.107154 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1454/2919] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:30.960099 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:30.969171 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922028e-3929-433a-9441-4f93d098aa97 service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:30.973484 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:30.974089 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:30.974368 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:30.974637 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:30.976650 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:30.987389 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:30.988858 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:30.997563 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1466/2920] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:31.073502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:31.082825 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d3fb-3342-41ca-aa66-ba39847f69b5 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:31.086594 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:31.087208 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:31.087502 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:31.087769 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:31.089617 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:31.102670 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:31.104121 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:31.117239 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1455/2921] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:31.181378 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:31.183328 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:31.198724 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51284-2c77-42c4-9a4d-e7354ba3c9dc service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:31.204621 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:31.205366 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:31.205645 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:31.205940 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:31.207933 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:31.220810 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:31.222393 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:31.232518 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1467/2922] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:32.540025 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:29:32.549131 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171d49-15e6-4837-a89f-030e7436cec8 service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:29:32.553688 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:29:32.554282 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:29:32.554553 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:29:32.554795 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:29:32.556952 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:29:32.566973 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:29:32.568437 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:29:32.576593 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1456/2923] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:29:41.228337 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=18 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:29:42.573020 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=18 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:13.007002 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:13.009489 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:13.027339 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9a19-35d4-479e-a684-5ea7f60b4142 service placement] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:13.033401 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:13.033963 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:13.034237 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:13.034506 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:13.037115 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:13.051071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:13.052825 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:13.067344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1468/2924] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:31:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:15.430455 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:15.445814 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050d63-84f6-4d19-930d-71dc68a5d4eb service neutron] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:15.452189 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acc4c0a07dfa4d738ce279cafb5fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:15.452810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:15.453086 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:15.453356 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:15.455341 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:15.468445 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:15.470030 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:15.480943 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1457/2925] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:19.228127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:19.238236 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4159ec6-2200-4b07-80ce-7b3c3707c1e4 service nova] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:19.242649 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3509a6c850854eb7904672398e2d6cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:19.243292 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:19.243578 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:19.243925 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:19.317665 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:19.319127 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:19.331036 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1469/2926] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:20.145780 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:20.162094 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6c1df-5d42-4ea4-871b-d45ada9f7ba0 service nova] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:20.167578 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:20.168415 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] REQUEST_METHOD: `GET` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:20.168765 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:20.169102 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:20.170955 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:20.184071 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:20.185737 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:20.206012 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1458/2927] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:31:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:31:23.403470 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:23.414476 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44fb21-9224-416b-96a7-d36158ec416c service neutron] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:23.419477 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:23.420128 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:23.420390 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:23.420655 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] PATH_INFO: `/v3/users/84f03546c48e4eb3b299b9846e84092a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:23.421828 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f03546c48e4eb3b299b9846e84092a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:23.423831 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:23.481324 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f03546c48e4eb3b299b9846e84092a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.481974 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f03546c48e4eb3b299b9846e84092a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.482601 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f03546c48e4eb3b299b9846e84092a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.493275 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f03546c48e4eb3b299b9846e84092a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.502519 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f03546c48e4eb3b299b9846e84092a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.523764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1470/2928] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:31:23 2022] DELETE /identity/v3/users/84f03546c48e4eb3b299b9846e84092a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:31:23.712612 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:23.725268 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925074-626b-41b6-8d14-cb6c4840083a service placement] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:23.789887 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:23.790535 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:23.790810 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:23.791084 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] PATH_INFO: `/v3/projects/21b15670aa1945ff81f66ff025959a94` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:23.792284 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b15670aa1945ff81f66ff025959a94)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:23.795142 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:23.841885 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b15670aa1945ff81f66ff025959a94', 'request_id': 'req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.848491 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b15670aa1945ff81f66ff025959a94', 'request_id': 'req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.854643 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b15670aa1945ff81f66ff025959a94', 'request_id': 'req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.869888 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] The token cache is being invalidate because project 21b15670aa1945ff81f66ff025959a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:31:23.870180 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.870794 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:23.872327 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1459/2929] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:31:23 2022] DELETE /identity/v3/projects/21b15670aa1945ff81f66ff025959a94 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:31:23.876344 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:23.877764 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:23.890815 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1868f4-8052-41dc-ab83-6c1c61eaf978 admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:23.939959 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:23.950617 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:23.951432 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:23.951771 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:23.952261 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] PATH_INFO: `/v3/users/0af7f4990cb54aa48ecd6f7badceaf3a` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:23.953455 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af7f4990cb54aa48ecd6f7badceaf3a)` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:23.955471 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:24.006175 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af7f4990cb54aa48ecd6f7badceaf3a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.006818 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af7f4990cb54aa48ecd6f7badceaf3a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.007449 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af7f4990cb54aa48ecd6f7badceaf3a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.016435 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af7f4990cb54aa48ecd6f7badceaf3a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.023807 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.notifications [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af7f4990cb54aa48ecd6f7badceaf3a'} {{(pid=81732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.041494 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1471/2930] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 13:31:23 2022] DELETE /identity/v3/users/0af7f4990cb54aa48ecd6f7badceaf3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:31:24.225322 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Authenticating user token {{(pid=81733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:31:24.226846 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.fernet_utils [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:31:24.239855 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1d0c7-b033-4dbf-b445-66588dd16ea6 admin admin] Validating token access rules against request {{(pid=81733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:31:24.299821 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91ee51bf97df4d1480625733920e3461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e6eefe19074b16ac82b646f2c6375a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:31:24.300465 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:31:24.300747 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:31:24.301021 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] PATH_INFO: `/v3/projects/a2e4676128f24bac98ae0eb1a36669ba` {{(pid=81733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:31:24.302213 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e4676128f24bac98ae0eb1a36669ba)` {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:31:24.304192 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] RBAC: Authorization granted {{(pid=81733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:31:24.310865 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:24.361983 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e4676128f24bac98ae0eb1a36669ba', 'request_id': 'req-122013b8-f82f-4728-8a2f-826c2946f973'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.372496 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e4676128f24bac98ae0eb1a36669ba', 'request_id': 'req-122013b8-f82f-4728-8a2f-826c2946f973'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.379033 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e4676128f24bac98ae0eb1a36669ba', 'request_id': 'req-122013b8-f82f-4728-8a2f-826c2946f973'} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.392600 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] The token cache is being invalidate because project a2e4676128f24bac98ae0eb1a36669ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 13:31:24.392879 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.393493 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG keystone.notifications [None req-122013b8-f82f-4728-8a2f-826c2946f973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 13:31:24.394976 dv-cinder-779578-4-smb devstack@keystone.service[81733]: [pid: 81733|app: 0|req: 1460/2931] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 13:31:24 2022] DELETE /identity/v3/projects/a2e4676128f24bac98ae0eb1a36669ba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 13:31:34.037973 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:31:34.390029 dv-cinder-779578-4-smb devstack@keystone.service[81733]: DEBUG dbcounter [-] [81733] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81733) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 13:32:49.767708 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Authenticating user token {{(pid=81732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 13:32:49.769409 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:32:49.912063 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b621ed-0c50-4f57-9f36-10572e3fc18f admin admin] Validating token access rules against request {{(pid=81732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 13:32:49.972917 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f703d30d689e4a5983b5d2c39cc68cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67f04698f8cf4c75894d62c37b907597', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 13:32:49.973525 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] REQUEST_METHOD: `GET` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 13:32:49.973800 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] SCRIPT_NAME: `/identity` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 13:32:49.974071 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 13:32:49.976126 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.fernet_utils [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 13:32:49.987540 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 13:32:49.989114 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89fe9e-1f41-4605-b6d2-18afabe91df0 service placement] RBAC: Authorization granted {{(pid=81732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 13:32:49.999619 dv-cinder-779578-4-smb devstack@keystone.service[81732]: [pid: 81732|app: 0|req: 1472/2932] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 13:32:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 13:32:59.995158 dv-cinder-779578-4-smb devstack@keystone.service[81732]: DEBUG dbcounter [-] [81732] Writing DB stats keystone:SELECT=89 {{(pid=81732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}